A Flexible Framework for Comprehensive Multimodal Model Evaluation
☆104Apr 21, 2026Updated last week
Alternatives and similar repositories for FlagEvalMM
Users that are interested in FlagEvalMM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Jul 24, 2024Updated last year
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆17Aug 7, 2025Updated 8 months ago
- ☆62Apr 1, 2025Updated last year
- [IJCAI 2024] CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning☆25Feb 1, 2024Updated 2 years ago
- This is the official repo for Contrastive Vision-Language Alignment Makes Efficient Instruction Learner.☆20Dec 1, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- FlagScale is a large model toolkit based on open-sourced projects.☆505Apr 24, 2026Updated last week
- A Survey on Jailbreak Attacks and Defenses against Multimodal Generative Models☆317Jan 11, 2026Updated 3 months ago
- ☆33Apr 23, 2026Updated last week
- FlagEval is an evaluation toolkit for AI large foundation models.☆337Apr 24, 2025Updated last year
- ☆11May 9, 2024Updated last year
- ☆12Jun 19, 2024Updated last year
- [CVPR 2025🔥] Official codebase for "Global-Local Tree Search in VLMs for 3D Indoor Scene Generation"☆20Apr 18, 2025Updated last year
- Official implementation of EgoHOD at ICLR 2025; 14 EgoVis Challenge Winners in CVPR 2024☆33Nov 25, 2025Updated 5 months ago
- [ACM MM2025]: Unleashing the Power of Data Generation in One-Pass Outdoor LiDAR Localization☆19Oct 29, 2025Updated 6 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆11Dec 20, 2024Updated last year
- FakePartsBench: 25K+ AI-generated videos with pixel- and frame-level annotations of full and partial deepfakes.☆24Aug 31, 2025Updated 8 months ago
- A public repository for ConDo (AAAI25 accepted)☆10Dec 21, 2024Updated last year
- my poc☆16Oct 28, 2020Updated 5 years ago
- [ACL'26 Findings] Official code for "BAPO: Boundary-Aware Policy Optimization for Reliable Agentic Search"☆26Apr 23, 2026Updated last week
- [CVPR 2025] This repository is intended to store the code and data for ASAP (Advancing Semantic Alignment Promotes Multi-Modal Manipulati…☆20Jun 18, 2025Updated 10 months ago
- [NeurIPS 2025] An official source code for paper "GuardReasoner-VL: Safeguarding VLMs via Reinforced Reasoning".☆122Feb 22, 2026Updated 2 months ago
- [CVPR 2025] RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concrete. Official Repository.☆387Oct 13, 2025Updated 6 months ago
- [ACM MM 2024] FKA-Owl: Advancing Multimodal Fake News Detection through Knowledge-Augmented LVLMs☆59Aug 8, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆10Sep 17, 2022Updated 3 years ago
- ☆14Nov 5, 2024Updated last year
- MetricEval: A framework that conceptualizes and operationalizes four main components of metric evaluation, in terms of reliability and va…☆12Nov 6, 2023Updated 2 years ago
- Debug DeepSpeed-Chat step by step in IDE (在IDE里一步一步调试DeepSpeed-Chat)☆10Apr 17, 2023Updated 3 years ago
- [BMVC'2022 Oral] Official code for Masked Supervised Learning for Semantic Segmentation.☆10Feb 8, 2023Updated 3 years ago
- Boosting the Class-Incremental Learning in 3D Point Clouds via Zero-Collection-Cost Basic Shape Pre-Training☆13Nov 30, 2024Updated last year
- A Massive Multi-Level Multi-Subject Knowledge Evaluation benchmark☆105Jul 20, 2023Updated 2 years ago
- [ICCV 2025] The official pytorch implement of "LLaVA-SP: Enhancing Visual Representation with Visual Spatial Tokens for MLLMs".☆23Oct 28, 2025Updated 6 months ago
- ☆43Sep 3, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official repository for the paper "Gradient-based Jailbreak Images for Multimodal Fusion Models" (https//arxiv.org/abs/2410.03489)☆19Oct 22, 2024Updated last year
- Octo manipulation policy in PyTorch☆19Jul 30, 2025Updated 9 months ago
- A marker-based augmented reality camera app for the web, powered by AR.js.☆16Dec 4, 2022Updated 3 years ago
- This repo focuses on self-training-based methods for 3D outdoor driving scenario LiDAR point clouds UDA segmentation.☆12Mar 8, 2026Updated last month
- Application for processing Chinese text : Sentiment , Keywords , Abstract☆10Apr 13, 2017Updated 9 years ago
- [EMNLP 2025 Main Oral] FedMABench: Benchmarking Mobile GUI Agents on Decentralized Heterogeneous User Data.☆16Nov 11, 2025Updated 5 months ago
- ☆11Apr 13, 2023Updated 3 years ago