A Flexible Framework for Comprehensive Multimodal Model Evaluation
☆107Apr 21, 2026Updated 4 months ago
Alternatives and similar repositories for FlagEvalMM
Users that are interested in FlagEvalMM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is the official repo for Contrastive Vision-Language Alignment Makes Efficient Instruction Learner.☆20Dec 1, 2023Updated 2 years ago
- ☆15Jul 24, 2024Updated 2 years ago
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆20Aug 7, 2025Updated last year
- ☆21Aug 19, 2024Updated 2 years ago
- ☆17Jul 18, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- FlagEval is an evaluation toolkit for AI large foundation models.☆338Apr 24, 2025Updated last year
- ☆30May 22, 2026Updated 3 months ago
- ✨✨ [ICLR 2026] MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models☆43Apr 10, 2025Updated last year
- ☆42Mar 24, 2026Updated 5 months ago
- This respository is used for time reasoning task for mult-session dialogue system.☆18Feb 7, 2026Updated 6 months ago
- ☆19Oct 28, 2025Updated 10 months ago
- Official Implementation of CODE☆18Sep 26, 2024Updated last year
- MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment☆35Jul 1, 2024Updated 2 years ago
- RoboBrain 2.5: Advanced version of RoboBrain. Depth in Sight, Time in Mind. 🎉🎉🎉☆1,136Feb 28, 2026Updated 6 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A Recipe for Building LLM Reasoners to Solve Complex Instructions☆32Oct 9, 2025Updated 10 months ago
- Official implementation of the ECCV2024 paper: Generalizable Facial Expression Recognition☆22Sep 20, 2024Updated last year
- (ACM MM24) This is the offical repository of GIST: Improving Parameter Efficient Fine Tuning via Knowledge Interaction.☆11Jan 28, 2024Updated 2 years ago
- Awesome Multimodal Agent☆112Aug 15, 2026Updated 2 weeks ago
- A Survey on Jailbreak Attacks and Defenses against Multimodal Generative Models☆334Jan 11, 2026Updated 7 months ago
- Longitudinal Evaluation of LLMs via Data Compression☆32May 29, 2024Updated 2 years ago
- Cross-Self KV Cache Pruning for Efficient Vision-Language Inference☆10Dec 15, 2024Updated last year
- The data and code for paper: "SOPBench: Evaluating Language Agents at Following Standard Operating Procedures and Constraints"☆19Nov 17, 2025Updated 9 months ago
- GaitParsing: Human Semantic Parsing for Gait Recognition (IEEE TMM)☆13May 20, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The first toolkit for MLRM safety evaluation, providing unified interface for mainstream models, datasets, and jailbreaking methods!☆15Apr 8, 2025Updated last year
- [ICLR 2025] MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs☆56Mar 25, 2025Updated last year
- A teleoperation framework with joint-level master-slave isomorphic mapping and end-effector pose teleoperation for Franka Research 3, bui…☆46Mar 23, 2026Updated 5 months ago
- Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment☆16Aug 6, 2024Updated 2 years ago
- my poc☆16Oct 28, 2020Updated 5 years ago
- ☆11Aug 7, 2026Updated 3 weeks ago
- ☆11Aug 20, 2025Updated last year
- CAD - Memory Efficient Convolutional Adapter for Segment Anything☆12Oct 4, 2024Updated last year
- [ACL 2025] Data and Code for Paper VLSBench: Unveiling Visual Leakage in Multimodal Safety☆62Jul 21, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Sep 17, 2022Updated 3 years ago
- ☆17May 14, 2025Updated last year
- Image Aesthetic Assessment in PyTorch with implemented popular datasets and models (possibly providing the pretrained ones).☆41Sep 7, 2022Updated 3 years ago
- [NeurIPS 2024] Official Repository of Multi-Object Hallucination in Vision-Language Models☆37Nov 13, 2024Updated last year
- (ICME24) This is the offical repository of iDAT: inverse Distillation Adapter-Tuning.☆13Apr 3, 2024Updated 2 years ago
- Xtuner Factory☆35Mar 1, 2024Updated 2 years ago
- Control LLM☆23Apr 6, 2025Updated last year