Lillianwei-h / MMIE

Related projects ⓘ

Alternatives and complementary repositories for MMIE

• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆14Updated 3 weeks ago
• iancovert / locality-alignment
  ☆29Updated 3 weeks ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆45Updated last month
• HanSolo9682 / CounterCurate
  This is the implementation of CounterCurate, the data curation pipeline of both physical and semantic counterfactual image-caption pairs.
  ☆17Updated 4 months ago
• zjunlp / Deco
  MLLM can see? Dynamic Correction Decoding for Hallucination Mitigation
  ☆17Updated last week
• umd-huang-lab / Mementos
  ☆24Updated 9 months ago
• eric-ai-lab / ProbMed
  "Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA"
  ☆15Updated 4 months ago
• Optimization-AI / fast_clip
  ☆19Updated last month
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆17Updated 3 weeks ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆29Updated 3 weeks ago
• nickjiang2378 / vl-interp
  Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"
  ☆29Updated 2 weeks ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆69Updated last month
• StanfordMIMI / villa
  ViLLA: Fine-grained vision-language representation learning from real-world data
  ☆40Updated last year
• scalable-model-editing / unified-model-editing
  We introduce EMMET and unify model editing with popular algorithms ROME and MEMIT.
  ☆12Updated 2 months ago
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 3 months ago
• richard-peng-xia / MMed-RAG
  [arXiv'24 & NeurIPSW'24] MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Models
  ☆53Updated 3 weeks ago
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆16Updated this week
• locuslab / llava-token-compression
  ☆15Updated this week
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• nverma1 / merging-text-transformers
  Code for "Merging Text Transformers from Different Initializations"
  ☆19Updated 3 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆11Updated last month
• claws-lab / projection-in-MLLMs
  Code and data for ACL 2024 paper on 'Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space'
  ☆11Updated 3 months ago
• harrytea / TGDoc
  arXiv 23 "Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs"
  ☆13Updated 9 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆33Updated 2 months ago
• markywg / transagent
  [NeurIPS 2024] TransAgent: Transfer Vision-Language Foundation Models with Heterogeneous Agent Collaboration
  ☆17Updated 3 weeks ago
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆33Updated 2 months ago
• mlvlab / RALF
  Official implementation of CVPR 2024 paper "Retrieval-Augmented Open-Vocabulary Object Detection".
  ☆27Updated 2 months ago
• k1rezaei / Text-to-concept
  ☆30Updated 9 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆57Updated 5 months ago