NVlabs / QLIPLinks
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆86Updated 6 months ago
Alternatives and similar repositories for QLIP
Users that are interested in QLIP are comparing it to the libraries listed below
Sorting:
- [CVPR 25] A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆37Updated 5 months ago
- FQGAN: Factorized Visual Tokenization and Generation☆53Updated 5 months ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆90Updated 7 months ago
- Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning☆114Updated 3 weeks ago
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆69Updated 11 months ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆127Updated 3 months ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆73Updated 2 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 11 months ago
- ☆88Updated 2 months ago
- ☆125Updated 2 months ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆130Updated 8 months ago
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆63Updated 6 months ago
- Uni-CoT: Towards Unified Chain-of-Thought Reasoning Across Text and Vision☆114Updated last week
- Official PyTorch Implementation of "Latent Denoising Makes Good Visual Tokenizers"☆125Updated last month
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆81Updated 6 months ago
- This is the official repository for the paper "FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehe…☆54Updated this week
- ☆74Updated 2 months ago
- Official implementation of Next Block Prediction: Video Generation via Semi-Autoregressive Modeling☆39Updated 7 months ago
- Official respository for ReasonGen-R1☆68Updated 2 months ago
- Structured Video Comprehension of Real-World Shorts☆190Updated last month
- [ICLR'25] Reconstructive Visual Instruction Tuning☆114Updated 5 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆71Updated 10 months ago
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models☆73Updated last year
- [ICCV 2025] Official repo for "GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation"☆186Updated 2 months ago
- Official Implementation of Paper Transfer between Modalities with MetaQueries☆228Updated 2 months ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers" [ICCV 2025]☆84Updated last month
- ☆38Updated 3 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆209Updated 4 months ago
- ☆37Updated 7 months ago
- [ICLR 2025] IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model☆36Updated 9 months ago