Now-Join-Us / OmniEvalKit
The code repository for "OmniEvalKit: A Modular, Lightweight Toolbox for Evaluating Large Language Model and its Omni-Extensions"
☆13Updated 3 weeks ago
Alternatives and similar repositories for OmniEvalKit:
Users that are interested in OmniEvalKit are comparing it to the libraries listed below
- ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse☆51Updated last year
- Papers about Hallucination in Multi-Modal Large Language Models (MLLMs)☆75Updated last month
- 关于LLM和Multimodal LLM的paper list☆23Updated 3 weeks ago
- [ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"☆78Updated last month
- ☆40Updated last month
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆76Updated 9 months ago
- the official repo for EMNLP 2024 (main) paper "EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimo…☆16Updated 3 months ago
- up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources☆72Updated last week
- 😎 curated list of awesome LMM hallucinations papers, methods & resources.☆147Updated 9 months ago
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …☆38Updated last month
- Official code for our paper "Model Composition for Multimodal Large Language Models" (ACL 2024)☆20Updated last week
- [CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding☆229Updated 3 months ago
- [Neurips'24 Spotlight] Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought …☆206Updated 3 weeks ago
- ☆116Updated last year
- [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.☆62Updated last month
- [CVPR 2024] How to Configure Good In-Context Sequence for Visual Question Answering☆16Updated 4 months ago
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆40Updated 2 months ago
- CHAIR metric is a rule-based metric for evaluating object hallucination in caption generation.☆26Updated last year
- The code repository for "Wings: Learning Multimodal LLMs without Text-only Forgetting" [NeurIPS 2024]☆13Updated 3 weeks ago
- [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models☆139Updated 8 months ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆87Updated 11 months ago
- An LLM-free Multi-dimensional Benchmark for Multi-modal Hallucination Evaluation☆105Updated last year
- Survey on Data-centric Large Language Models☆72Updated 6 months ago
- The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆194Updated 9 months ago
- ☆55Updated 6 months ago
- This is the first released survey paper on hallucinations of large vision-language models (LVLMs). To keep track of this field and contin…☆58Updated 5 months ago
- A RLHF Infrastructure for Vision-Language Models☆145Updated 2 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆60Updated 7 months ago
- Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models☆86Updated 10 months ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆77Updated 9 months ago