deepseek-ai / Janus
Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation
☆917Updated last week
Related projects ⓘ
Alternatives and complementary repositories for Janus
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆675Updated 3 months ago
- Next-Token Prediction is All You Need☆1,793Updated 2 weeks ago
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.☆509Updated last week
- Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.☆1,827Updated 3 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,305Updated 2 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆702Updated 9 months ago
- Codebase for Aria - an Open Multimodal Native MoE☆787Updated this week
- ☆781Updated 3 weeks ago
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆801Updated 2 months ago
- 🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)☆809Updated 4 months ago
- Official Implementation of "Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraini…☆495Updated 2 months ago
- A family of lightweight multimodal models.☆928Updated 3 weeks ago
- Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"☆774Updated 2 months ago
- ☆259Updated last week
- LLaVA-Interactive-Demo☆351Updated 3 months ago
- VILA - a multi-image visual language model with training, inference and evaluation recipe, deployable from cloud to edge (Jetson Orin and…☆1,980Updated last week
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆622Updated last month
- HPT - Open Multimodal LLMs from HyperGAI☆312Updated 5 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆436Updated last week
- [ACL 2024] Progressive LLaMA with Block Expansion.☆478Updated 5 months ago
- Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,011Updated last week
- ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM☆949Updated 2 weeks ago
- ☆570Updated 8 months ago
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆644Updated last month
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆856Updated last week
- Official repository for the paper PLLaVA☆584Updated 3 months ago
- Code for Quiet-STaR☆641Updated 2 months ago
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆875Updated last month
- MINT-1T: A one trillion token multimodal interleaved dataset.☆770Updated 3 months ago