Holistic evaluation of multimodal foundation models
☆49Aug 11, 2024Updated last year
Alternatives and similar repositories for HEMM
Users that are interested in HEMM are comparing it to the libraries listed below
Sorting:
- ☆12Oct 23, 2022Updated 3 years ago
- The Social-IQ 2.0 Challenge Release for the Artificial Social Intelligence Workshop at ICCV '23☆36Oct 13, 2023Updated 2 years ago
- ☆72Jul 30, 2025Updated 7 months ago
- ☆19Jun 4, 2025Updated 9 months ago
- Code and data for EMNLP 2023 paper "Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?"☆15Jan 25, 2024Updated 2 years ago
- Official repository for "DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation (ACL2023 Findings)"☆11May 23, 2023Updated 2 years ago
- ☆32Jul 11, 2024Updated last year
- This repository contains the implementation of Concept Activation Regions, a new framework to explain deep neural networks with human con…☆16Oct 7, 2022Updated 3 years ago
- This repository contains the code of our paper 'Skip \n: A simple method to reduce hallucination in Large Vision-Language Models'.☆15Feb 12, 2024Updated 2 years ago
- [NeurIPS2023] "Selectivity Drives Productivity: Efficient Dataset Pruning for Enhanced Transfer Learning" by Yihua Zhang*, Yimeng Zhang*,…☆14Oct 12, 2023Updated 2 years ago
- ☆16Oct 21, 2024Updated last year
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆19Nov 19, 2024Updated last year
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆67Feb 19, 2025Updated last year
- [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"☆20Oct 17, 2024Updated last year
- 🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"☆40Nov 21, 2025Updated 4 months ago
- ☆20Nov 17, 2025Updated 4 months ago
- Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning (ICML 2023)☆19Dec 15, 2023Updated 2 years ago
- Social-AI papers across computing communities, courses, and dissertations.☆21Jun 10, 2025Updated 9 months ago
- [TMLR 2022] High-Modality Multimodal Transformer☆117Nov 2, 2024Updated last year
- ☆18Aug 1, 2024Updated last year
- KUDA: Keypoints to Unify Dynamics Learning and Visual Prompting for Open-Vocabulary Robotic Manipulation☆22Apr 23, 2025Updated 11 months ago
- ☆14Feb 7, 2024Updated 2 years ago
- Code for ICLR 2024 paper "Towards Optimal Feature-Shaping Methods for Out-of-Distribution Detection"☆17Apr 20, 2024Updated last year
- [NeurIPS 2021] “Improving Contrastive Learning on Imbalanced Data via Open-World Sampling”, Ziyu Jiang, Tianlong Chen, Ting Chen, Zhangya…☆29Dec 30, 2021Updated 4 years ago
- code & model for arxiv paper "Autoregressive Image Generation with Masked Bit Modeling"☆40Feb 10, 2026Updated last month
- VaLM: Visually-augmented Language Modeling. ICLR 2023.☆56Mar 6, 2023Updated 3 years ago
- [Neurips 2023] Official pytorch implementation of "Addressing Negative Transfer in Diffusion Models"☆23Jul 4, 2024Updated last year
- Open sourced result for The Agent Company☆21Nov 11, 2025Updated 4 months ago
- ☆34Aug 7, 2025Updated 7 months ago
- [ICLR 2024 Spotlight] Bounding Box Stability against Feature Dropout Reflects Detector Generalization across Environments☆20Aug 19, 2025Updated 7 months ago
- Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…☆40May 26, 2025Updated 9 months ago
- Antonino Furnari's fork of Feichtenhofer's gpu_flow, with temporal dilation.☆10Sep 18, 2020Updated 5 years ago
- Code for MInD: Multimodal Information Disentanglement☆18Dec 17, 2025Updated 3 months ago
- ☆22Oct 10, 2024Updated last year
- ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio☆52Jul 11, 2025Updated 8 months ago
- (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.☆361Jan 14, 2025Updated last year
- [NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning☆618Jan 27, 2024Updated 2 years ago
- ☆13Dec 13, 2022Updated 3 years ago
- ☆33Nov 26, 2025Updated 3 months ago