kyegomez / MegaVIT
The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"
☆27Updated last month
Alternatives and similar repositories for MegaVIT:
Users that are interested in MegaVIT are comparing it to the libraries listed below
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated 8 months ago
- Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch☆47Updated 3 months ago
- Official Pytorch Implementation of Self-emerging Token Labeling☆32Updated 11 months ago
- Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"☆15Updated 4 months ago
- Explorations into improving ViTArc with Slot Attention☆38Updated 4 months ago
- The official repo of continuous speculative decoding☆24Updated 3 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆75Updated 4 months ago
- ☆68Updated 3 months ago
- NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…☆39Updated 4 months ago
- Implementation of a modular, high-performance, and simplistic mamba for high-speed applications☆33Updated 4 months ago
- Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"☆50Updated last month
- Official implementation of ECCV24 paper: POA☆24Updated 7 months ago
- Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch☆100Updated last year
- minisora-DiT, a DiT reproduction based on XTuner from the open source community MiniSora☆40Updated 11 months ago
- Description and applications of OpenAI's paper about DALL-E (2021) and implementation of other (CLIP-guided) zero-shot text-to-image gene…☆32Updated 2 years ago
- Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"☆101Updated 6 months ago
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆15Updated 4 months ago
- SIEVE: Multimodal Dataset Pruning using Image-Captioning Models (CVPR 2024)☆14Updated 10 months ago
- Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!☆40Updated last year
- ☆22Updated 5 months ago
- A simple reproducible template to implement AI research papers☆23Updated 6 months ago
- ☆26Updated 10 months ago
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆45Updated 3 weeks ago
- Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"☆24Updated last month
- Minimal Implementation of Visual Autoregressive Modelling (VAR)☆28Updated this week
- Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.☆38Updated this week
- JAX implementation ViT-VQGAN☆82Updated 2 years ago
- ☆33Updated last year