Alternatives and similar repositories for Multimodality-Representation-Learning

Users that are interested in Multimodality-Representation-Learning are comparing it to the libraries listed below

• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆55Updated 6 months ago
• zhjohnchan / awesome-vision-and-language-pretraining
  A curated list of vision-and-language pre-training (VLP). :-)
  ☆59Updated 3 years ago
• Yuco-Z / Awesome-Multi-Modal-Dialog
  [Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
  ☆37Updated 9 months ago
• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆98Updated last year
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆63Updated 3 years ago
• vincentlux / Awesome-Multimodal-LLM
  Reading list for Multimodal Large Language Models
  ☆68Updated 2 years ago
• d-ailin / CLIP-Guided-Decoding
  ☆17Updated last year
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆68Updated 3 years ago
• drmuskangarg / Multimodal-datasets
  This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and …
  ☆312Updated 3 years ago
• kugwzk / DiDE
  Code for EMNLP 2022 paper “Distilled Dual-Encoder Model for Vision-Language Understanding”
  ☆31Updated 2 years ago
• YulongBonjour / SimVLM
  SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION
  ☆36Updated 3 years ago
• debjitpaul / Causal_CoT
  About The corresponding code from our paper " Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoning…
  ☆12Updated last year
• Wusiwei0410 / SciMMIR
  ☆24Updated last year
• tianyang-x / Mixture-of-Domain-Adapters
  Codebase for ACL 2023 paper "Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memori…
  ☆51Updated 2 years ago
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated 10 months ago
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆149Updated last year
• declare-lab / MM-InstructEval
  This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimoda…
  ☆29Updated 8 months ago
• changdaeoh / multimodal-mixup
  Official implementation for NeurIPS'23 paper "Geodesic Multi-Modal Mixup for Robust Fine-Tuning"
  ☆35Updated last year
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆44Updated 4 months ago
• DmitryRyumin / EMNLP-2023-Papers
  EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural langu…
  ☆110Updated last year
• zjukg / Structure-CLIP
  [Paper][AAAI2024]Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
  ☆151Updated last year
• limanling / clip-event
  ☆106Updated 3 years ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• lezhang7 / MOQAGPT
  [EMNLP'2023 Findings] MoqaGPT, for zero-shot multimodal question answering with LLMs
  ☆13Updated 10 months ago
• deepaknlp / MedVidQACL
  Implementation of the Benchmark Approaches for Medical Instructional Video Classification (MedVidCL) and Medical Video Question Answering…
  ☆30Updated 2 years ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆53Updated last year
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated 10 months ago
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆37Updated 2 years ago
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆57Updated last year
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated 2 years ago