baaivision / Emu3
Next-Token Prediction is All You Need
β1,965Updated 2 months ago
Alternatives and similar repositories for Emu3:
Users that are interested in Emu3 are comparing it to the libraries listed below
- Autoregressive Model Beats Diffusion: π¦ Llama for Scalable Image Generationβ1,460Updated 5 months ago
- Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.β1,129Updated 3 weeks ago
- VideoSys: An easy and efficient system for video generationβ1,875Updated 2 weeks ago
- Janus-Series: Unified Multimodal Understanding and Generation Modelsβ1,327Updated 2 months ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionsβ2,709Updated 3 weeks ago
- β3,272Updated 3 months ago
- Infinity β : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesisβ871Updated this week
- Latte: Latent Diffusion Transformer for Video Generation.β1,756Updated 3 months ago
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.β1,823Updated 2 months ago
- A family of lightweight multimodal models.β972Updated last month
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generationβ708Updated 5 months ago
- GPT4V-level open-source multi-modal model based on Llama3-8Bβ2,204Updated 4 months ago
- Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarksβ1,689Updated this week
- SEED-Voken: A Series of Powerful Visual Tokenizersβ810Updated 2 weeks ago
- DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingβ797Updated this week
- Emu Series: Generative Multimodal Models from BAAIβ1,673Updated 3 months ago
- Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAIβ900Updated this week
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)β758Updated 5 months ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMsβ1,013Updated last week
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.β595Updated last month
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"β732Updated 5 months ago
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Mβ¦β492Updated 9 months ago
- A Framework of Small-scale Large Multimodal Modelsβ709Updated 3 weeks ago
- β¨β¨VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interactionβ1,932Updated this week
- Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"β742Updated 10 months ago
- Official repository for the paper PLLaVAβ630Updated 5 months ago
- [CVPR2024 Highlight] VBench - We Evaluate Video Generationβ695Updated this week
- PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838β1,234Updated 3 months ago
- This repo contains the code for 1D tokenizer and generatorβ645Updated this week
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Languageβ613Updated 2 months ago