mshukor / xl-vlms
XL-VLMs: General Repository for eXplainable Large Vision Language Models
☆20Updated 3 months ago
Alternatives and similar repositories for xl-vlms:
Users that are interested in xl-vlms are comparing it to the libraries listed below
- The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?☆28Updated 5 months ago
- ☆73Updated 3 weeks ago
- Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations" (ICLR '25)☆66Updated last month
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆82Updated 11 months ago
- ☆53Updated 5 months ago
- [ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models☆82Updated 6 months ago
- Code for Reducing Hallucinations in Vision-Language Models via Latent Space Steering☆49Updated 4 months ago
- [ICML 2024 Oral] Official code repository for MLLM-as-a-Judge.☆67Updated 2 months ago
- CLIP-MoE: Mixture of Experts for CLIP☆31Updated 6 months ago
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆75Updated 7 months ago
- ☆36Updated 2 months ago
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆71Updated 10 months ago
- [NeurIPS 2024] Mitigating Object Hallucination via Concentric Causal Attention☆53Updated 3 months ago
- ☆10Updated 2 months ago
- Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆126Updated 2 months ago
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆65Updated 10 months ago
- ECSO (Make MLLM safe without neither training nor any external models!) (https://arxiv.org/abs/2403.09572)☆23Updated 5 months ago
- HallE-Control: Controlling Object Hallucination in LMMs☆30Updated last year
- This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…☆78Updated 2 months ago
- [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning☆52Updated 2 months ago
- This repo contains the code for the paper "Understanding and Mitigating Hallucinations in Large Vision-Language Models via Modular Attrib…☆14Updated last month
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆82Updated last year
- [CVPR 2025] Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention☆28Updated 9 months ago
- [ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"☆80Updated last year
- [NeurIPS 2024] Official Repository of Multi-Object Hallucination in Vision-Language Models☆28Updated 5 months ago
- [ICLR 2025] Official codebase for the ICLR 2025 paper "Multimodal Situational Safety"☆13Updated last month
- [ICML 2024] Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models☆127Updated 5 months ago
- ☆22Updated 2 months ago
- V1: Toward Multimodal Reasoning by Designing Auxiliary Task☆31Updated last week
- [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.☆71Updated 5 months ago