rccchoudhury / rltLinks
Official Implementation for our NeurIPS 2024 paper, "Don't Look Twice: Run-Length Tokenization for Faster Video Transformers".
☆211Updated 2 months ago
Alternatives and similar repositories for rlt
Users that are interested in rlt are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆330Updated last month
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆178Updated last month
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆129Updated last month
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"☆66Updated 2 months ago
- ☆163Updated 5 months ago
- Scaling Vision Pre-Training to 4K Resolution☆161Updated last month
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆327Updated 3 months ago
- Adaptive Caching for Faster Video Generation with Diffusion Transformers☆147Updated 6 months ago
- An open source implementation of CLIP (With TULIP Support)☆147Updated 2 weeks ago
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆158Updated 2 months ago
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆74Updated 3 months ago
- Official implementation of the paper: REPA-E: Unlocking VAE for End-to-End Tuning of Latent Diffusion Transformers☆233Updated last month
- VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning☆140Updated 2 weeks ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 7 months ago
- [ICLR 2025] Autoregressive Video Generation without Vector Quantization☆510Updated last week
- [ICLR 2025] OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation☆298Updated this week
- Official repo for "GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation"☆155Updated last month
- Official PyTorch implementation of TokenSet.☆121Updated 2 months ago
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆145Updated 5 months ago
- ☆195Updated 3 months ago
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆124Updated 9 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆107Updated last month
- When do we not need larger vision models?☆393Updated 3 months ago
- [CVPR 2025] DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention☆166Updated 3 months ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆69Updated 3 months ago
- Object Recognition as Next Token Prediction (CVPR 2024 Highlight)☆178Updated last month
- [CVPR 2025] CoDe: Collaborative Decoding Makes Visual Auto-Regressive Modeling Efficient☆102Updated 2 months ago
- FlexTok: Resampling Images into 1D Token Sequences of Flexible Length☆143Updated last week
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆115Updated last month
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆354Updated last month