kyegomez / MegaVITLinks
The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"
☆29Updated 3 weeks ago
Alternatives and similar repositories for MegaVIT
Users that are interested in MegaVIT are comparing it to the libraries listed below
Sorting:
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated last year
- Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch☆55Updated 11 months ago
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆181Updated last year
- The official repo of continuous speculative decoding☆30Updated 7 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆82Updated last year
- Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"☆101Updated last year
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆94Updated 8 months ago
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆53Updated 8 months ago
- MobileLLM-R1☆58Updated last month
- ☆71Updated last year
- Implementation of a multimodal diffusion transformer in Pytorch☆106Updated last year
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆37Updated last year
- Experimental scripts for researching data adaptive learning rate scheduling.☆22Updated 2 years ago
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆102Updated 2 years ago
- Implementation of a modular, high-performance, and simplistic mamba for high-speed applications☆36Updated last year
- The Gaussian Histogram Loss (HL-Gauss) proposed by Imani et al. with a few convenient wrappers for regression, in Pytorch☆67Updated 3 months ago
- ☆31Updated 2 months ago
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated 2 years ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆133Updated 2 weeks ago
- WeGeFT: Weight‑Generative Fine‑Tuning for Multi‑Faceted Efficient Adaptation of Large Models☆22Updated 4 months ago
- ☆39Updated last year
- Official Pytorch Implementation of Self-emerging Token Labeling☆35Updated last year
- [NeurIPS 2025 Oral] Exploring Diffusion Transformer Designs via Grafting☆61Updated 5 months ago
- [AAAI 2025] Does VLM Classification Benefit from LLM Description Semantics?☆23Updated 3 months ago
- Implementation of a Light Recurrent Unit in Pytorch☆49Updated last year
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆56Updated last year
- ☆54Updated 2 years ago
- Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"☆54Updated 9 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆57Updated last year
- ☆71Updated 3 months ago