FreedomIntelligence / LongLLaVA
LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
☆189Updated last month
Alternatives and similar repositories for LongLLaVA:
Users that are interested in LongLLaVA are comparing it to the libraries listed below
- Long Context Transfer from Language to Vision☆360Updated 3 months ago
- Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models☆131Updated 2 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆156Updated 4 months ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆127Updated 3 months ago
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆151Updated last month
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆144Updated 4 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆295Updated last week
- Official implementation of the Law of Vision Representation in MLLMs☆149Updated 3 months ago
- Explore the Limits of Omni-modal Pretraining at Scale☆96Updated 5 months ago
- ☆110Updated 6 months ago
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆227Updated 6 months ago
- [ICLR 2025] VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation☆227Updated 3 weeks ago
- The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A su…☆223Updated last month
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)☆198Updated this week
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆89Updated last month
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆116Updated 9 months ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆364Updated last month
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation☆86Updated 3 weeks ago
- VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆95Updated 7 months ago
- The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"☆141Updated last month
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆255Updated 7 months ago
- ☆132Updated last year
- E5-V: Universal Embeddings with Multimodal Large Language Models☆231Updated last month
- Matryoshka Multimodal Models☆97Updated 3 weeks ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆101Updated 2 weeks ago
- [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…☆109Updated 2 months ago
- Official repository of MMDU dataset☆83Updated 4 months ago
- The official code of the paper "PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction".☆53Updated last month
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"☆165Updated 4 months ago
- This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"☆128Updated 8 months ago