NVlabs / EAGLE
Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs
☆635Updated last month
Alternatives and similar repositories for EAGLE:
Users that are interested in EAGLE are comparing it to the libraries listed below
- An open-source implementation for training LLaVA-NeXT.☆385Updated 5 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆554Updated 9 months ago
- ☆377Updated 3 months ago
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆297Updated 3 weeks ago
- Investigating CoT Reasoning in Autoregressive Image Generation☆559Updated this week
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆555Updated 10 months ago
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆282Updated 2 months ago
- Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.☆2,242Updated this week
- 🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos☆981Updated last week
- ☆223Updated 3 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆255Updated 11 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,049Updated 5 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆241Updated 2 months ago
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,275Updated last week
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆459Updated 3 months ago
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆489Updated this week
- Official repository for the paper PLLaVA☆643Updated 7 months ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Semantic Pyramid via Hierarchical Window Transformer☆369Updated last week
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models☆206Updated 6 months ago
- ☆346Updated 10 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆319Updated 3 weeks ago
- A family of lightweight multimodal models.☆1,006Updated 4 months ago
- Rethinking Step-by-step Visual Reasoning in LLMs☆279Updated 2 months ago
- a family of versatile and state-of-the-art video tokenizers.☆354Updated this week
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆156Updated 6 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆315Updated 8 months ago
- Long Context Transfer from Language to Vision☆368Updated last week
- ☆365Updated 3 weeks ago
- ☆602Updated last year
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆703Updated last month