kyegomez / MegaVIT
The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"
☆28Updated 2 months ago
Alternatives and similar repositories for MegaVIT:
Users that are interested in MegaVIT are comparing it to the libraries listed below
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated 9 months ago
- Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch☆47Updated 4 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆75Updated 4 months ago
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆81Updated last month
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆31Updated 9 months ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated last year
- Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"☆24Updated 2 weeks ago
- A simple reproducible template to implement AI research papers☆23Updated 6 months ago
- ☆37Updated 11 months ago
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆35Updated 9 months ago
- Explorations into improving ViTArc with Slot Attention☆39Updated 5 months ago
- Implementation of ViTaR: ViTAR: Vision Transformer with Any Resolution in PyTorch☆33Updated 4 months ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"☆54Updated 2 weeks ago
- More dimensions = More fun☆21Updated 8 months ago
- Official PyTorch implementation of "No Time to Waste: Squeeze Time into Channel for Mobile Video Understanding"☆32Updated 10 months ago
- The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows☆57Updated 2 weeks ago
- Minimal Implementation of Visual Autoregressive Modelling (VAR)☆28Updated last week
- My implementation of the model KosmosG from "KOSMOS-G: Generating Images in Context with Multimodal Large Language Models"☆14Updated 4 months ago
- Official implementation of ECCV24 paper: POA☆24Updated 7 months ago
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆42Updated 2 weeks ago
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆170Updated 9 months ago
- Description and applications of OpenAI's paper about DALL-E (2021) and implementation of other (CLIP-guided) zero-shot text-to-image gene…☆32Updated 2 years ago
- ☆31Updated 2 months ago
- JAX implementation ViT-VQGAN☆82Updated 2 years ago
- Official Pytorch Implementation of Self-emerging Token Labeling☆32Updated last year
- An interactive demo based on Segment-Anything for stroke-based painting which enables human-like painting.☆34Updated last year
- Implementation of a Light Recurrent Unit in Pytorch☆47Updated 5 months ago
- Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public☆80Updated last month
- Implementation of the text to video model LUMIERE from the paper: "A Space-Time Diffusion Model for Video Generation" by Google Research☆51Updated 2 months ago
- [ICLR 2025 Spotlight] Official Implementation for ToST (Token Statistics Transformer)☆78Updated last month