Alternatives and similar repositories for vlis

Users that are interested in vlis are comparing it to the libraries listed below

• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆47Updated 8 months ago
• kaistAI / Volcano
  [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…
  ☆46Updated 11 months ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• d-ailin / CLIP-Guided-Decoding
  ☆17Updated last year
• bcdnlp / FAITHSCORE
  FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models
  ☆30Updated 4 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆33Updated last year
• edchengg / oven_eval
  ICCV 2023 (Oral) Open-domain Visual Entity Recognition Towards Recognizing Millions of Wikipedia Entities
  ☆43Updated last month
• lscpku / VITATECS
  ☆18Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆77Updated last year
• FreedomIntelligence / TRIM
  We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…
  ☆15Updated 7 months ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆63Updated 3 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆79Updated 8 months ago
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆16Updated last year
• archiki / RepARe
  ☆19Updated last year
• MrZilinXiao / AutoVER
  [ECCV'24] Official Implementation of Autoregressive Visual Entity Recognizer.
  ☆14Updated last year
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆46Updated 8 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• muirbench / MuirBench
  A Comprehensive Benchmark for Robust Multi-image Understanding
  ☆12Updated 11 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• LgQu / TIGeR
  Code for paper: Unified Text-to-Image Generation and Retrieval
  ☆15Updated last year
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆46Updated 3 weeks ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated 2 years ago
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆56Updated last year
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆21Updated 7 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆47Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆36Updated 4 months ago
• Saehyung-Lee / PlugIR
  Official repository of "Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach" (ACL 2024 Oral)
  ☆32Updated 4 months ago