rccchoudhury / rlt
Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
☆207Updated 2 weeks ago
Alternatives and similar repositories for rlt:
Users that are interested in rlt are comparing it to the libraries listed below
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆271Updated 2 months ago
- Object Recognition as Next Token Prediction (CVPR 2024 Highlight)☆175Updated 3 months ago
- Official PyTorch implementation of TokenSet.☆114Updated 3 weeks ago
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆146Updated 3 weeks ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆320Updated last month
- [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation☆272Updated last month
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆68Updated last month
- [ICLR 2025][arXiv:2406.07548] Image and Video Tokenization with Binary Spherical Quantization☆145Updated 10 months ago
- ☆156Updated 4 months ago
- An open source implementation of CLIP (With TULIP Support)☆125Updated 3 weeks ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"☆60Updated 3 weeks ago
- Supercharged BLIP-2 that can handle videos☆117Updated last year
- ☆192Updated 2 months ago
- ☆171Updated 6 months ago
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆273Updated 2 months ago
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆144Updated 5 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 6 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆86Updated this week
- Scaling Vision Pre-Training to 4K Resolution☆110Updated 3 weeks ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆468Updated 2 weeks ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆63Updated 2 months ago
- A Unified Tokenizer for Visual Generation and Understanding☆249Updated this week
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆123Updated 7 months ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆155Updated 3 months ago
- When do we not need larger vision models?☆386Updated 2 months ago
- [CVPR 2025] CoDe: Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient☆96Updated 2 weeks ago
- Official PyTorch Implementation of "Diffusion Autoencoders are Scalable Image Tokenizers"☆110Updated 2 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆90Updated this week
- DDT: Decoupled Diffusion Transformer☆97Updated this week
- ☆176Updated 2 months ago