Alternatives and similar repositories for Multimodality-Representation-Learning

Users that are interested in Multimodality-Representation-Learning are comparing it to the libraries listed below

• zhjohnchan / awesome-vision-and-language-pretraining
  A curated list of vision-and-language pre-training (VLP). :-)
  ☆59Updated 3 years ago
• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆53Updated 5 months ago
• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆97Updated last year
• drmuskangarg / Multimodal-datasets
  This repository is build in association with our position paper on "Multimodality for NLP-Centered Applications: Resources, Advances and …
  ☆305Updated 3 years ago
• zjukg / Structure-CLIP
  [Paper][AAAI2024]Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
  ☆147Updated last year
• Yuco-Z / Awesome-Multi-Modal-Dialog
  [Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
  ☆38Updated 7 months ago
• miguelsvasco / gmc
  Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)
  ☆28Updated 8 months ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• YulongBonjour / SimVLM
  SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION
  ☆36Updated 2 years ago
• vincentlux / Awesome-Multimodal-LLM
  Reading list for Multimodal Large Language Models
  ☆68Updated 2 years ago
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆43Updated 3 years ago
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆150Updated last year
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆68Updated 3 years ago
• waltonfuture / InstructionGPT-4
  InstructionGPT-4
  ☆41Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• declare-lab / MM-InstructEval
  This repository contains code to evaluate various multimodal large language models using different instructions across multiple multimoda…
  ☆29Updated 6 months ago
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated 8 months ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆52Updated last year
• miccunifi / ISSUES
  [ICCVW 2023] - Mapping Memes to Words for Multimodal Hateful Meme Classification
  ☆26Updated 4 months ago
• Wusiwei0410 / SciMMIR
  ☆24Updated last year
• tianyang-x / Mixture-of-Domain-Adapters
  Codebase for ACL 2023 paper "Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memori…
  ☆51Updated last year
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆63Updated 3 years ago
• YeonwooSung / LIMoE-pytorch
  PyTorch implementation of LIMoE
  ☆52Updated last year
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆43Updated 2 months ago
• DmitryRyumin / EMNLP-2023-Papers
  EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural langu…
  ☆109Updated last year
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆164Updated 11 months ago
• zengyan-97 / X2-VLM
  All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)
  ☆165Updated last year
• ivonajdenkoska / multimodal-meta-learn
  [ICLR 2023] Official code repository for "Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning"
  ☆59Updated 2 years ago
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆166Updated 2 years ago
• ShiZhengyan / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆96Updated last year