NVlabs / QLIPLinks
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆87Updated 7 months ago
Alternatives and similar repositories for QLIP
Users that are interested in QLIP are comparing it to the libraries listed below
Sorting:
- Uni-CoT: Towards Unified Chain-of-Thought Reasoning Across Text and Vision☆146Updated last week
- ☆128Updated 3 months ago
- FQGAN: Factorized Visual Tokenization and Generation☆53Updated 6 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆128Updated 4 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 11 months ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆92Updated 7 months ago
- Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning☆117Updated last month
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆82Updated 7 months ago
- ☆75Updated 3 months ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆73Updated 2 months ago
- Official PyTorch Implementation of "Latent Denoising Makes Good Visual Tokenizers"☆133Updated 2 months ago
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆70Updated 11 months ago
- Code and dataset link for "DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World"☆109Updated this week
- ☆90Updated 3 months ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆130Updated 8 months ago
- [NeurIPS 2025] HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆66Updated 2 weeks ago
- [CVPR 25] A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆37Updated 6 months ago
- Official respository for ReasonGen-R1☆69Updated 3 months ago
- Official Implementation of Paper Transfer between Modalities with MetaQueries☆240Updated 2 months ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆118Updated 5 months ago
- Official implementation of Next Block Prediction: Video Generation via Semi-Autoregressive Modeling☆39Updated 7 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆71Updated 11 months ago
- Implementation for "The Scalability of Simplicity: Empirical Analysis of Vision-Language Learning with a Single Transformer"☆65Updated last month
- [ICCV2025]Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆169Updated 4 months ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆57Updated last year
- [ICCV 2025] Official repo for "GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation"☆187Updated 3 months ago
- T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation☆29Updated 2 weeks ago
- Structured Video Comprehension of Real-World Shorts☆203Updated 2 weeks ago
- ☆37Updated 8 months ago
- This is an early exploration to introduce Interleaving Reasoning to Text-to-image Generation field and achieve the SoTA benchmark perform…☆59Updated 3 weeks ago