NVlabs / QLIP
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆69Updated 2 months ago
Alternatives and similar repositories for QLIP:
Users that are interested in QLIP are comparing it to the libraries listed below
- A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆29Updated last month
- FQGAN: Factorized Visual Tokenization and Generation☆50Updated last month
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆99Updated 2 weeks ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆69Updated 2 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 6 months ago
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆66Updated 2 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆68Updated 6 months ago
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆54Updated 6 months ago
- ☆30Updated 2 months ago
- ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoning☆31Updated 3 weeks ago
- Codes accompanying the paper "Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment"☆31Updated 2 months ago
- ☆80Updated last month
- PyTorch implementation of DiffMoE, TC-DiT, EC-DiT and Dense DiT☆76Updated 2 weeks ago
- Autoregressive Image Generation with Randomized Parallel Decoding☆53Updated last month
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics☆91Updated last month
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆57Updated 2 months ago
- [Neurips 2024] Video Diffusion Models are Training-free Motion Interpreter and Controller☆40Updated 3 weeks ago
- Code release for "PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Drop" (arXiv 2025)☆28Updated last month
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆35Updated 10 months ago
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆55Updated 2 months ago
- TokenBridge: Bridging Continuous and Discrete Tokens for Autoregressive Visual Generation. https://yuqingwang1029.github.io/TokenBridge☆106Updated this week
- Spatial-R1: The first MLLM trained using GRPO for spatial reasoning in videos☆31Updated this week
- [CVPR2025] A benchmark for evaluating video generative models in generating short stories☆15Updated this week
- ReNeg: Learning Negative Embedding with Reward Guidance☆31Updated 4 months ago
- A list of works on video generation towards world model☆53Updated this week
- ElasticTok: Adaptive Tokenization for Image and Video☆67Updated 6 months ago
- Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆77Updated 3 weeks ago
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models☆71Updated 11 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆151Updated 2 weeks ago
- Official repo for "GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation"☆139Updated last week