showlab / Show-o
Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.
☆797Updated this week
Related projects: ⓘ
- Open-MAGVIT2: Democratizing Autoregressive Visual Generation☆579Updated last week
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI☆522Updated this week
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,197Updated last month
- This repo contains the code for our paper An Image is Worth 32 Tokens for Reconstruction and Generation☆389Updated last week
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"☆591Updated last month
- PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838☆763Updated this week
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆496Updated 2 months ago
- Implementation of MagViT2 Tokenizer in Pytorch☆537Updated last month
- Official implementation of SEED-LLaMA (ICLR 2024).☆557Updated 5 months ago
- VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks☆354Updated 2 months ago
- Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"☆590Updated 6 months ago
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers☆490Updated 2 months ago
- Official repository for the paper PLLaVA☆551Updated last month
- ☆277Updated 7 months ago
- ☆556Updated 7 months ago
- A Framework of Small-scale Large Multimodal Models☆568Updated last week
- [CVPR2024 Highlight] VBench - We Evaluate Video Generation☆484Updated 2 weeks ago
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆486Updated 5 months ago
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆378Updated 5 months ago
- A collection of awesome video generation studies.☆258Updated last week
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆553Updated this week
- When do we not need larger vision models?☆314Updated last month
- Official Implementation of "Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraini…☆457Updated last month
- [CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want☆639Updated last month
- PyTorch implementation of RCG https://arxiv.org/abs/2312.03701☆789Updated 5 months ago
- Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)☆505Updated 4 months ago
- A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".☆887Updated last year
- [ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model☆357Updated 6 months ago
- A family of lightweight multimodal models.☆877Updated 2 weeks ago
- ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆365Updated 3 months ago