NVlabs / QLIPLinks
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆75Updated 3 months ago
Alternatives and similar repositories for QLIP
Users that are interested in QLIP are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆62Updated 8 months ago
- FQGAN: Factorized Visual Tokenization and Generation☆49Updated 2 months ago
- ☆48Updated this week
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆111Updated 2 weeks ago
- ☆84Updated 2 months ago
- [CVPR 25] A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆30Updated 2 months ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆72Updated 4 months ago
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆70Updated 3 months ago
- Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?☆51Updated 3 weeks ago
- Ego-R1: Chain-of-Tool-Thought for Ultra-Long Egocentric Video Reasoning☆50Updated this week
- Codes accompanying the paper "Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment"☆33Updated 4 months ago
- Code for ICML 2025 Paper "Highly Compressed Tokenizer Can Generate Without Training"☆71Updated last week
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models☆71Updated last year
- [ICLR'25] Reconstructive Visual Instruction Tuning☆92Updated 2 months ago
- A list of works on video generation towards world model☆151Updated this week
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics☆116Updated last month
- Official code for MotionBench (CVPR 2025)☆44Updated 3 months ago
- PyTorch implementation of DiffMoE, TC-DiT, EC-DiT and Dense DiT☆113Updated 2 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆69Updated 7 months ago
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆60Updated 4 months ago
- Autoregressive Image Generation with Randomized Parallel Decoding☆67Updated 2 months ago
- official repo for "VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation" [EMNLP2024]☆91Updated 4 months ago
- Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆124Updated last month
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆87Updated 8 months ago
- ☆95Updated this week
- official training and inference code of bitwise tokenizer☆28Updated last month
- [CVPR 2025] Science-T2I: Addressing Scientific Illusions in Image Synthesis☆55Updated last month
- ☆36Updated 4 months ago
- [Neurips 2024] Video Diffusion Models are Training-free Motion Interpreter and Controller☆41Updated 2 months ago
- ☆45Updated 4 months ago