CircleRadon / TokenPacker
The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".
☆233Updated last month
Alternatives and similar repositories for TokenPacker:
Users that are interested in TokenPacker are comparing it to the libraries listed below
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆531Updated 7 months ago
- An open-source implementation for training LLaVA-NeXT.☆375Updated 3 months ago
- [ICLR 2025] Mathematical Visual Instruction Tuning for Multi-modal Large Language Models☆117Updated last month
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆272Updated 6 months ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆154Updated 3 months ago
- [NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"☆163Updated 4 months ago
- Official implementation of the Law of Vision Representation in MLLMs☆148Updated 2 months ago
- [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'☆137Updated last week
- A collection of visual instruction tuning datasets.☆76Updated 10 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆151Updated 4 months ago
- SVIT: Scaling up Visual Instruction Tuning☆164Updated 7 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆252Updated 7 months ago
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆198Updated 2 weeks ago
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆279Updated last month
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆268Updated 3 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆104Updated 3 months ago
- Official repo of Griffon series including v1(ECCV 2024), v2, and G☆130Updated 2 weeks ago
- ☆109Updated 6 months ago
- Official repository of MMDU dataset☆82Updated 4 months ago
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆130Updated last month
- Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).☆152Updated 4 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆89Updated 10 months ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆144Updated 4 months ago
- The official implementation of RAR☆79Updated 10 months ago
- official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input☆62Updated 5 months ago
- Official implementation of "Towards Efficient Visual Adaption via Structural Re-parameterization".☆179Updated 9 months ago
- ✨✨ MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?☆89Updated last week
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆124Updated last year
- [ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation☆81Updated last week
- The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆138Updated this week