rccchoudhury / rlt
Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
☆210Updated last month
Alternatives and similar repositories for rlt:
Users that are interested in rlt are comparing it to the libraries listed below
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆313Updated last week
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆156Updated 2 weeks ago
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆108Updated last week
- Official implementation of the paper: REPA-E: Unlocking VAE for End-to-End Tuning of Latent Diffusion Transformers☆190Updated 3 weeks ago
- ☆193Updated 2 months ago
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆147Updated 6 months ago
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆333Updated 2 weeks ago
- Object Recognition as Next Token Prediction (CVPR 2024 Highlight)☆176Updated last week
- [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation☆288Updated 2 months ago
- [CVPR 2025] CoDe: Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient☆98Updated last month
- Scaling Vision Pre-Training to 4K Resolution☆155Updated last week
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆492Updated 2 weeks ago
- An open source implementation of CLIP (With TULIP Support)☆132Updated last month
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆151Updated last month
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆100Updated 2 weeks ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆324Updated 2 months ago
- ☆159Updated 4 months ago
- SpeeD: A Closer Look at Time Steps is Worthy of Triple Speed-Up for Diffusion Model Training☆178Updated 3 months ago
- DDT: Decoupled Diffusion Transformer☆233Updated 3 weeks ago
- FlexTok: Resampling Images into 1D Token Sequences of Flexible Length☆126Updated last month
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆69Updated 2 months ago
- VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning☆115Updated 2 weeks ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"☆64Updated last month
- Official repo for "GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation"☆142Updated 2 weeks ago
- Official PyTorch implementation of TokenSet.☆116Updated last month
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆55Updated 2 months ago
- [CVPR 2025] DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention☆164Updated 2 months ago
- Densely Captioned Images (DCI) dataset repository.☆180Updated 10 months ago
- My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"☆230Updated last month
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling☆402Updated this week