facebookresearch / metamorphLinks
Code for MetaMorph Multimodal Understanding and Generation via Instruction Tuning
☆178Updated last month
Alternatives and similar repositories for metamorph
Users that are interested in metamorph are comparing it to the libraries listed below
Sorting:
- ☆163Updated 5 months ago
- [CVPR2025 Highlight] PAR: Parallelized Autoregressive Visual Generation. https://yuqingwang1029.github.io/PAR-project☆158Updated 2 months ago
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆331Updated 3 months ago
- Official repository of "GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing"☆250Updated last month
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆71Updated 3 months ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆124Updated 4 months ago
- The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"☆86Updated 7 months ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆330Updated last month
- WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generation☆101Updated last week
- TokenBridge: Bridging Continuous and Discrete Tokens for Autoregressive Visual Generation. https://yuqingwang1029.github.io/TokenBridge☆116Updated 3 weeks ago
- Pytorch implementation for the paper titled "SimpleAR: Pushing the Frontier of Autoregressive Visual Generation"☆358Updated last month
- Selftok: Discrete Visual Tokens of Autoregression, by Diffusion, and for Reasoning☆112Updated this week
- ☆111Updated last week
- A Unified Tokenizer for Visual Generation and Understanding☆314Updated 2 weeks ago
- Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).☆129Updated last month
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆74Updated 3 months ago
- [CVPR 2025 (Oral)] Open implementation of "RandAR"☆155Updated 2 months ago
- Official repo for "GigaTok: Scaling Visual Tokenizers to 3 Billion Parameters for Autoregressive Image Generation"☆155Updated last month
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆107Updated last month
- Official implementation of the paper: REPA-E: Unlocking VAE for End-to-End Tuning of Latent Diffusion Transformers☆233Updated last month
- Official implementation of the Law of Vision Representation in MLLMs☆155Updated 6 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆327Updated 3 months ago
- Video Generation, Physical Commonsense, Semantic Adherence, VideoCon-Physics☆106Updated last month
- [CVPR2025] PyTorch-based reimplementation of CrossFlow, as proposed in 'Flowing from Words to Pixels: A Noise-Free Framework for Cross-Mo…☆188Updated 2 months ago
- [NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective☆69Updated 7 months ago
- Code Release of Harmonizing Visual Representations for Unified Multimodal Understanding and Generation☆117Updated 2 weeks ago
- This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…☆125Updated 11 months ago
- This repository includes the official implementation of our paper "Beyond Next-Token: Next-X Prediction for Autoregressive Visual Generat…☆207Updated last month
- VARGPT-v1.1: Improve Visual Autoregressive Large Unified Model via Iterative Instruction Tuning and Reinforcement Learning☆245Updated last month
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆60Updated 3 months ago