rccchoudhury / rlt
Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
☆188Updated 2 months ago
Alternatives and similar repositories for rlt:
Users that are interested in rlt are comparing it to the libraries listed below
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆222Updated 3 weeks ago
- ☆187Updated this week
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆382Updated last week
- [arXiv'25] Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models☆232Updated last month
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆142Updated 3 months ago
- The official implementation of PAR: Parallelized Autoregressive Visual Generation. https://epiphqny.github.io/PAR-project/☆110Updated last month
- [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation☆239Updated this week
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆290Updated this week
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆83Updated 4 months ago
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆167Updated 7 months ago
- HART: Efficient Visual Generation with Hybrid Autoregressive Transformer☆416Updated 4 months ago
- CoDe: Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient☆75Updated 3 weeks ago
- Official PyTorch and Diffusers Implementation of "LinFusion: 1 GPU, 1 Minute, 16K Image"☆289Updated last month
- Scaling Diffusion Transformers with Mixture of Experts☆252Updated 5 months ago
- Liquid: Language Models are Scalable Multi-modal Generators☆63Updated 2 months ago
- When do we not need larger vision models?☆364Updated last week
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆73Updated 3 weeks ago
- SpeeD: A Closer Look at Time Steps is Worthy of Triple Speed-Up for Diffusion Model Training☆174Updated 2 weeks ago
- ☆134Updated last month
- [ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model☆400Updated 3 months ago
- VideoVAE+: Large Motion Video Autoencoding with Cross-modal Video VAE☆278Updated 3 weeks ago
- ☆138Updated last month
- [ICLR 2025][arXiv:2406.07548] Image and Video Tokenization with Binary Spherical Quantization☆126Updated 8 months ago
- Implements VAR+CLIP for text-to-image (T2I) generation☆119Updated 3 weeks ago
- My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"☆213Updated 2 weeks ago
- [CVPR 2024] On the Content Bias in Fréchet Video Distance☆102Updated 4 months ago
- Object Recognition as Next Token Prediction (CVPR 2024 Highlight)☆171Updated last month
- Scalable Diffusion Models with State Space Backbone☆151Updated 11 months ago
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆119Updated 5 months ago