Alternatives and similar repositories for Multimodality-Representation-Learning

Users that are interested in Multimodality-Representation-Learning are comparing it to the libraries listed below

• zhjohnchan / awesome-vision-and-language-pretraining
  A curated list of vision-and-language pre-training (VLP). :-)
  ☆59Updated 3 years ago
• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆55Updated 6 months ago
• Yuco-Z / Awesome-Multi-Modal-Dialog
  [Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
  ☆37Updated 8 months ago
• vincentlux / Awesome-Multimodal-LLM
  Reading list for Multimodal Large Language Models
  ☆68Updated 2 years ago
• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆97Updated last year
• YulongBonjour / SimVLM
  SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION
  ☆36Updated 2 years ago
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆63Updated 3 years ago
• drmuskangarg / Multimodal-datasets
  This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and …
  ☆309Updated 3 years ago
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆43Updated 3 years ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆53Updated last year
• DmitryRyumin / EMNLP-2023-Papers
  EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural langu…
  ☆110Updated last year
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated 9 months ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated 2 years ago
• zjukg / Structure-CLIP
  [Paper][AAAI2024]Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
  ☆150Updated last year
• deepaknlp / MedVidQACL
  Implementation of the Benchmark Approaches for Medical Instructional Video Classification (MedVidCL) and Medical Video Question Answering…
  ☆29Updated 2 years ago
• Wusiwei0410 / SciMMIR
  ☆24Updated last year
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆68Updated 3 years ago
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆57Updated last year
• calpt / awesome-adapter-resources
  Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
  ☆198Updated last year
• jmhessel / caption_contest_corpus
  Corpus to accompany: "Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contest"
  ☆57Updated 7 months ago
• miccunifi / ISSUES
  [ICCVW 2023] - Mapping Memes to Words for Multimodal Hateful Meme Classification
  ☆27Updated 6 months ago
• lzcemma / LeMDA
  Code Example for Learning Multimodal Data Augmentation in Feature Space
  ☆43Updated 2 years ago
• debjitpaul / Causal_CoT
  About The corresponding code from our paper " Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoning…
  ☆12Updated last year
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆149Updated last year
• tianyang-x / Mixture-of-Domain-Adapters
  Codebase for ACL 2023 paper "Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memori…
  ☆51Updated 2 years ago
• Heidelberg-NLP / MM-SHAP
  This is the official implementation of the paper "MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision…
  ☆31Updated last year
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆166Updated last year
• YeonwooSung / LIMoE-pytorch
  PyTorch implementation of LIMoE
  ☆52Updated last year
• declare-lab / MM-InstructEval
  This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimoda…
  ☆29Updated 7 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year