shxie2020 / Awesome-UGVFM
A collection of vision foundation models unifying understanding and generation.
☆55Updated 4 months ago
Alternatives and similar repositories for Awesome-UGVFM
Users that are interested in Awesome-UGVFM are comparing it to the libraries listed below
Sorting:
- Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆97Updated last month
- [NeurIPS 2024] The official implement of research paper "FreeLong : Training-Free Long Video Generation with SpectralBlend Temporal Atten…☆44Updated 2 months ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆119Updated 3 months ago
- WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation☆83Updated last month
- ImageGen-CoT: Enhancing Text-to-Image In-context Learning with Chain-of-Thought Reasoning☆31Updated last month
- [CVPR 2025 (Oral)] Open implementation of "RandAR"☆134Updated last month
- A framework named B^2-DiffuRL for RL-based diffusion model fine-tuning.☆29Updated last month
- PyTorch implementation of DiffMoE, TC-DiT, EC-DiT and Dense DiT☆78Updated 3 weeks ago
- Spatial-R1: The first MLLM trained using GRPO for spatial reasoning in videos☆33Updated this week
- FQGAN: Factorized Visual Tokenization and Generation☆50Updated last month
- Code for: "Long-Context Autoregressive Video Modeling with Next-Frame Prediction"☆199Updated 2 weeks ago
- Awesome Unified Multimodal Models☆77Updated this week
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆55Updated 6 months ago
- Frequency Autoregressive Image Generation with Continuous Tokens☆63Updated 2 months ago
- Autoregressive Image Generation with Randomized Parallel Decoding☆57Updated last month
- Official Implementation of VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual intervention☆36Updated 3 weeks ago
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics☆99Updated last week
- GenDoP: Auto-regressive Camera Trajectory Generation as a Director of Photography☆52Updated last month
- Diffusion Powers Video Tokenizer for Comprehension and Generation (CVPR 2025)☆67Updated 2 months ago
- [NeurlPS 2024] One Token to Seg Them All: Language Instructed Reasoning Segmentation in Videos☆118Updated 4 months ago
- Code release for "PISA Experiments: Exploring Physics Post-Training for Video Diffusion Models by Watching Stuff Drop" (ICML 2025)☆29Updated this week
- [ICML2025] The code and data of Paper: Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation☆102Updated 6 months ago
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆151Updated last month
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 7 months ago
- Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning☆160Updated 3 weeks ago
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆70Updated 2 months ago
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆49Updated last month
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆68Updated 6 months ago
- Code for [CVPR 2025] ROICtrl: Boosting Instance Control for Visual Generation☆108Updated 3 weeks ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆68Updated 3 months ago