NVlabs / QLIPLinks
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆74Updated 3 months ago
Alternatives and similar repositories for QLIP
Users that are interested in QLIP are comparing it to the libraries listed below
Sorting:
- FQGAN: Factorized Visual Tokenization and Generation☆50Updated 2 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆107Updated last month
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆69Updated 3 months ago
- ☆81Updated last month
- ☆33Updated 3 months ago
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆59Updated 7 months ago
- [CVPR 25] A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆29Updated 2 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆69Updated 7 months ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆39Updated this week
- Codes accompanying the paper "Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment"☆32Updated 3 months ago
- Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆115Updated 2 weeks ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆89Updated last month
- PyTorch implementation of DiffMoE, TC-DiT, EC-DiT and Dense DiT☆98Updated last month
- A list of works on video generation towards world model☆101Updated last week
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆68Updated 3 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆178Updated last month
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics☆106Updated 3 weeks ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆35Updated 11 months ago
- GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning☆67Updated this week
- official training and inference code of bitwise tokenizer☆24Updated 2 weeks ago
- ElasticTok: Adaptive Tokenization for Image and Video☆69Updated 6 months ago
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆59Updated 3 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 7 months ago
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆59Updated 2 months ago
- [Neurips 2024] Video Diffusion Models are Training-free Motion Interpreter and Controller☆42Updated last month
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆62Updated 3 months ago
- [CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models☆40Updated 3 months ago
- The official implementation of "Neighboring Autoregressive Modeling for Efficient Visual Generation"☆50Updated last month
- Autoregressive Image Generation with Randomized Parallel Decoding☆63Updated 2 months ago
- [NeurIPS 2024] EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models.☆47Updated 7 months ago