GAIR-NLP / anole
Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
☆696Updated 4 months ago
Alternatives and similar repositories for anole:
Users that are interested in anole are comparing it to the libraries listed below
- Janus-Series: Unified Multimodal Understanding and Generation Models☆1,232Updated last month
- A family of lightweight multimodal models.☆955Updated 3 weeks ago
- Official Implementation of "Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretraini…☆512Updated 4 months ago
- Official implementation of SEED-LLaMA (ICLR 2024).☆585Updated 2 months ago
- HPT - Open Multimodal LLMs from HyperGAI☆313Updated 6 months ago
- Next-Token Prediction is All You Need☆1,904Updated last month
- LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images☆323Updated 2 months ago
- ☆580Updated 10 months ago
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…☆366Updated last week
- Long Context Transfer from Language to Vision☆347Updated 3 weeks ago
- Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,081Updated this week
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆717Updated 10 months ago
- ✨✨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆422Updated this week
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆266Updated last week
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆659Updated 2 months ago
- SEED-Voken: A Series of Powerful Visual Tokenizers☆772Updated last week
- Multimodal Models in Real World☆415Updated last month
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆402Updated 2 weeks ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,398Updated 4 months ago
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆544Updated 2 months ago
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.☆577Updated 3 weeks ago
- Official repository for the paper PLLaVA☆613Updated 4 months ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆601Updated last month
- Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"☆796Updated 3 months ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆390Updated this week
- ☆328Updated last month
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆300Updated 4 months ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆202Updated this week
- Implementation of DoRA☆284Updated 6 months ago