NVlabs / QLIPLinks
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆90Updated 7 months ago
Alternatives and similar repositories for QLIP
Users that are interested in QLIP are comparing it to the libraries listed below
Sorting:
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆92Updated 8 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated last year
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆70Updated last year
- Official PyTorch Implementation of "Latent Denoising Makes Good Visual Tokenizers"☆140Updated this week
- ☆130Updated last week
- Uni-CoT: Towards Unified Chain-of-Thought Reasoning Across Text and Vision☆160Updated last month
- FQGAN: Factorized Visual Tokenization and Generation☆54Updated 6 months ago
- ☆91Updated 4 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆129Updated 4 months ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆75Updated 3 months ago
- Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning☆122Updated 2 months ago
- ☆75Updated 4 months ago
- Official implementation of Next Block Prediction: Video Generation via Semi-Autoregressive Modeling☆39Updated 8 months ago
- Official Implementation of Paper Transfer between Modalities with MetaQueries☆253Updated 2 weeks ago
- Official respository for ReasonGen-R1☆70Updated 4 months ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆121Updated 6 months ago
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆81Updated 8 months ago
- [ICCV2025]Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆177Updated 5 months ago
- https://huggingface.co/datasets/multimodal-reasoning-lab/Zebra-CoT☆87Updated 2 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆71Updated 11 months ago
- [NeurIPS 2025] HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆71Updated last month
- [CVPR 25] A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆44Updated 6 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆214Updated 6 months ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆130Updated 9 months ago
- ☆53Updated 3 weeks ago
- Official repository for the UAE paper, unified-GRPO, and unified-Bench☆142Updated last month
- [ICCV 2025] Official repo for "GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation"☆187Updated 4 months ago
- Code and dataset link for "DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World"☆112Updated 3 weeks ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆61Updated last year
- A list of works on video generation towards world model☆167Updated last week