THUNLP-MT / CODIS
Repo for paper "CODIS: Benchmarking Context-Dependent Visual Comprehension for Multimodal Large Language Models".
☆11Updated 4 months ago
Alternatives and similar repositories for CODIS:
Users that are interested in CODIS are comparing it to the libraries listed below
- Pythonic wrappers for Cider/CiderD evaluation metrics. Provides CIDEr as well as CIDEr-D (CIDEr Defended) which is more robust to gaming …☆12Updated last year
- Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)☆42Updated 3 months ago
- ☆11Updated last month
- ☆41Updated 3 months ago
- ☆61Updated 8 months ago
- An benchmark for evaluating the capabilities of large vision-language models (LVLMs)☆43Updated last year
- A Self-Training Framework for Vision-Language Reasoning☆64Updated 3 weeks ago
- A hot-pluggable tool for visualizing LLaVA's attention.☆13Updated last year
- ☆11Updated 8 months ago
- Official Code of IdealGPT☆34Updated last year
- MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale☆32Updated 2 months ago
- M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning☆55Updated last month
- Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"☆49Updated 4 months ago
- Official Implementation of UA^{2}-Agent and other baseline algorithms of "Towards Unified Alignment Between Agents, Humans, and Environme…☆16Updated 3 months ago
- ☆39Updated last year
- ☆24Updated 4 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆63Updated 8 months ago
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆63Updated 3 months ago
- ☆19Updated 3 months ago
- The Code for Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models☆14Updated 4 months ago
- Code and data for ACL 2024 paper on 'Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space'☆11Updated 7 months ago
- Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)☆52Updated 4 months ago
- [Preprint] A Neural-Symbolic Self-Training Framework☆102Updated 6 months ago
- [ACL 2024] Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models☆16Updated 7 months ago
- ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio☆39Updated 4 months ago
- The code for Consistent In-Context Editing, an approach for tuning language models through contextual distributions, overcoming the limit…☆25Updated 3 months ago
- The rule-based evaluation subset and code implementation of Omni-MATH☆16Updated 2 months ago
- Official implementation of paper 'Look Twice Before You Answer: Memory-Space Visual Retracing for Hallucination Mitigation in Multimodal …☆39Updated last week
- ☆67Updated last year
- [EMNLP 2024] ”ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models“☆16Updated 7 months ago