open-compass / VLMEvalKitLinks
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
☆3,799Updated this week
Alternatives and similar repositories for VLMEvalKit
Users that are interested in VLMEvalKit are comparing it to the libraries listed below
Sorting:
- ☆4,552Updated 4 months ago
- EasyR1: An Efficient, Scalable, Multi-Modality RL Training Framework based on veRL☆4,572Updated last week
- A Framework of Small-scale Large Multimodal Models☆960Updated 9 months ago
- An open-source implementaion for fine-tuning Qwen-VL series by Alibaba Cloud.☆1,642Updated 3 weeks ago
- A fork to add multimodal model training to open-r1☆1,449Updated last year
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,921Updated 8 months ago
- One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks☆3,608Updated last week
- Witness the aha moment of VLM with less than $3.☆4,029Updated 8 months ago
- A family of lightweight multimodal models.☆1,050Updated last year
- Famous Vision Language Models and Their Architectures☆1,172Updated 3 weeks ago
- 🔥🔥🔥 [IEEE TCSVT] Latest Papers, Codes and Datasets on Vid-LLMs.☆3,066Updated last month
- 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models☆2,299Updated 6 months ago
- This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-bas…☆1,349Updated 2 months ago
- [ICCV 2025] LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning☆2,124Updated last month
- Solve Visual Understanding with Reinforced VLMs☆5,833Updated 3 months ago
- Next-Token Prediction is All You Need☆2,314Updated 3 weeks ago
- Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey☆956Updated 2 months ago
- 📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).☆975Updated 4 months ago
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆1,983Updated 3 months ago
- A Next-Generation Training Engine Built for Ultra-Large MoE Models☆5,082Updated this week
- A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.☆1,425Updated 4 months ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆1,277Updated last year
- [ICLR & NeurIPS 2025] Repository for Show-o series, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,865Updated last month
- Collection of AWESOME vision-language models for vision tasks☆3,075Updated 3 months ago
- Strong and Open Vision Language Assistant for Mobile Devices☆1,330Updated last year
- [ICLR2026] This is the first paper to explore how to effectively use R1-like RL for MLLMs and introduce Vision-R1, a reasoning MLLM that…☆760Updated last week
- Extend OpenRLHF to support LMM RL training for reproduction of DeepSeek-R1 on multimodal tasks.☆840Updated 8 months ago
- VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and clou…☆3,737Updated 2 months ago
- ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis☆729Updated 2 months ago
- 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment☆865Updated last year