pliang279 / HEMM
Holistic evaluation of multimodal foundation models
☆43Updated 7 months ago
Alternatives and similar repositories for HEMM:
Users that are interested in HEMM are comparing it to the libraries listed below
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆74Updated 6 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆80Updated 10 months ago
- Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆120Updated last month
- Official PyTorch Implementation for Task Vectors are Cross-Modal☆22Updated 3 months ago
- Preference Learning for LLaVA☆40Updated 4 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆65Updated 9 months ago
- Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…☆25Updated this week
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆38Updated last year
- 🔥 [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"☆26Updated last month
- [ICLR 2025] MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation☆40Updated 3 months ago
- ☆46Updated 4 months ago
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆42Updated 5 months ago
- [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs☆24Updated 5 months ago
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆40Updated 2 weeks ago
- Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations" (ICLR '25)☆62Updated 2 weeks ago
- Code for T-MARS data filtering☆35Updated last year
- [ACL2023, Findings] Source codes for the paper "Werewolf Among Us: Multimodal Resources for Modeling Persuasion Behaviors in Social Deduc…☆12Updated last month
- [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆59Updated 8 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆44Updated 2 months ago
- ☆47Updated 7 months ago
- ☆54Updated 11 months ago
- Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)☆28Updated 5 months ago
- Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆34Updated 4 months ago
- ☆30Updated 2 months ago
- ☆23Updated 5 months ago
- PyTorch implementation of StableMask (ICML'24)☆12Updated 8 months ago
- Official repo of Progressive Data Expansion: data, code and evaluation☆28Updated last year
- Language Quantized AutoEncoders☆102Updated 2 years ago