NVlabs / QLIPLinks
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆83Updated 5 months ago
Alternatives and similar repositories for QLIP
Users that are interested in QLIP are comparing it to the libraries listed below
Sorting:
- Official PyTorch Implementation of "Latent Denoising Makes Good Visual Tokenizers"☆120Updated last month
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆67Updated 10 months ago
- FQGAN: Factorized Visual Tokenization and Generation☆52Updated 4 months ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆88Updated 6 months ago
- [CVPR 25] A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆34Updated 4 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆124Updated 2 months ago
- ☆121Updated 2 months ago
- Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning☆106Updated this week
- Uni-CoT: Towards Unified Chain-of-Thought Reasoning Across Text and Vision☆96Updated 2 weeks ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 10 months ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆68Updated last month
- ☆87Updated 2 months ago
- Official implementation of Next Block Prediction: Video Generation via Semi-Autoregressive Modeling☆38Updated 6 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆70Updated 9 months ago
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆63Updated 6 months ago
- ☆70Updated 2 months ago
- Structured Video Comprehension of Real-World Shorts☆177Updated 3 weeks ago
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆74Updated 6 months ago
- ☆37Updated 6 months ago
- Official Implementation of Paper Transfer between Modalities with MetaQueries☆219Updated last month
- [ICLR'25] Reconstructive Visual Instruction Tuning☆103Updated 4 months ago
- GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning☆94Updated 2 months ago
- [ICCV2025]Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆155Updated 3 months ago
- ShotBench: Expert-Level Cinematic Understanding in Vision-Language Models☆72Updated last month
- Codes accompanying the paper "Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment"☆33Updated 6 months ago
- Code and dataset link for "DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World"☆98Updated last month
- PyTorch implementation of DiffMoE, TC-DiT, EC-DiT and Dense DiT☆122Updated 4 months ago
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆79Updated last month
- Empowering Unified MLLM with Multi-granular Visual Generation☆130Updated 7 months ago
- Adaptive Length Image Tokenization via Recurrent Allocation | How many tokens is an image worth ?☆127Updated 6 months ago