Alternatives and similar repositories for MMFM-Challenge

Users that are interested in MMFM-Challenge are comparing it to the libraries listed below

• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated 5 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆106Updated 3 months ago
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆79Updated last year
• yfzhang114 / LLaVA-Align
  This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…
  ☆78Updated 2 months ago
• SivanDoveh / TSVLC
  Repository for the paper: Teaching Structured Vision & Language Concepts to Vision & Language Models
  ☆46Updated last year
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆66Updated 11 months ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆56Updated last month
• rohan598 / ConTextual
  ☆25Updated 9 months ago
• facebookresearch / genecis
  Code and Models for "GeneCIS A Benchmark for General Conditional Image Similarity"
  ☆58Updated last year
• Computer-Vision-in-the-Wild / Elevater_Toolkit_IC
  Toolkit for Elevater Benchmark
  ☆72Updated last year
• showlab / datacentric.vlp
  Compress conventional Vision-Language Pre-training data
  ☆51Updated last year
• vinid / neg_clip
  NegCLIP.
  ☆31Updated 2 years ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆50Updated 6 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆76Updated 8 months ago
• ExplainableML / WaffleCLIP
  Official repository for the ICCV 2023 paper: "Waffling around for Performance: Visual Classification with Random Words and Broad Concepts…
  ☆57Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• BAAI-DCAI / Dataset-Pruning
  Dataset pruning for ImageNet and LAION-2B.
  ☆79Updated 10 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• UCSC-VLAA / CLIPS
  An Enhanced CLIP Framework for Learning with Synthetic Captions
  ☆30Updated 3 weeks ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆54Updated last month
• lezhang7 / Enhance-FineGrained
  [CVPR 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding
  ☆49Updated last month
• mbzuai-oryx / CVRR-Evaluation-Suite
  [CVPRW-25 MMFM] Official repository of paper titled "How Good is my Video LMM? Complex Video Reasoning and Robustness Evaluation Suite fo…
  ☆47Updated 8 months ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆83Updated last year
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆87Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆83Updated last year
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆20Updated 4 months ago
• jmerullo / limber
  https://arxiv.org/abs/2209.15162
  ☆50Updated 2 years ago
• mlfoundations / VisIT-Bench
  ☆51Updated last year
• keio-smilab24 / Polos
  [CVPR24 Highlights] Polos: Multimodal Metric Learning from Human Feedback for Image Captioning
  ☆30Updated 10 months ago