NVlabs / QLIP
[arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
☆61Updated 3 weeks ago
Alternatives and similar repositories for QLIP:
Users that are interested in QLIP are comparing it to the libraries listed below
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆86Updated 2 months ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆56Updated last month
- FQGAN: Factorized Visual Tokenization and Generation☆45Updated 2 months ago
- Official implementation of Next Block Prediction: Video Generation via Semi-Autoregressive Modeling☆26Updated last month
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆65Updated last month
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆53Updated last month
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆51Updated 5 months ago
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆50Updated last month
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 5 months ago
- TokenBridge: Bridging Continuous and Discrete Tokens for Autoregressive Visual Generation☆49Updated last week
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆64Updated 4 months ago
- A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆17Updated last week
- The official implementation of "Neighboring Autoregressive Modeling for Efficient Visual Generation"☆30Updated last week
- [ICLR 2025] Implementation of Accelerating Auto-regressive Text-to-Image Generation with Training-free Speculative Jacobi Decoding☆29Updated 3 weeks ago
- Codes accompanying the paper "Toward Guidance-Free AR Visual Generation via Condition Contrastive Alignment"☆26Updated last month
- ☆24Updated 3 months ago
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics☆88Updated last week
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆38Updated this week
- [ICLR 2025] Reconstructive Visual Instruction Tuning☆73Updated 3 weeks ago
- Official code for MotionBench (CVPR 2025)☆31Updated 3 weeks ago
- [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…☆35Updated 9 months ago
- TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models☆29Updated 4 months ago
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models☆68Updated 10 months ago
- Official Implementation of VideoDPO☆68Updated 2 months ago
- official repo for "VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation" [EMNLP2024]☆82Updated last month
- ReNeg: Learning Negative Embedding with Reward Guidance☆31Updated 2 months ago
- ☆27Updated 2 months ago
- [CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models☆34Updated last month
- [NeurIPS 2024] EvolveDirector: Approaching Advanced Text-to-Image Generation with Large Vision-Language Models.☆47Updated 5 months ago
- ☆29Updated 7 months ago