Alternatives and similar repositories for multimodal_transformers:

Users that are interested in multimodal_transformers are comparing it to the libraries listed below

• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆81Updated 3 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• allenai / sherlock
  Code, data, models for the Sherlock corpus
  ☆57Updated 2 years ago
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆33Updated last year
• goel-shashank / CyCLIP
  ☆117Updated 2 years ago
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆90Updated last year
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 3 years ago
• e-bug / iglue
  [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"
  ☆49Updated 2 years ago
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆33Updated last year
• allenai / gpv2
  ☆32Updated 3 years ago
• google-research / fnc
  ☆26Updated 3 years ago
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• songweige / Contrastive-Learning-with-Non-Semantic-Negatives
  Robust Contrastive Learning Using Negative Samples with Diminished Semantics (NeurIPS 2021)
  ☆38Updated 3 years ago
• LuoweiZhou / coco-caption
  kdexd/coco-caption@de6f385
  ☆26Updated 4 years ago
• cdancette / detect-shortcuts
  Repo for ICCV 2021 paper: Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering
  ☆26Updated 9 months ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆223Updated 3 years ago
• pliang279 / HighMMT
  [TMLR 2022] High-Modality Multimodal Transformer
  ☆114Updated 5 months ago
• NewsStoriesData / newsstories.github.io
  ☆22Updated 2 years ago
• facebookresearch / GDT
  We present a framework for training multi-modal deep learning models on unlabelled video data by forcing the network to learn invariances…
  ☆47Updated 3 years ago
• McGill-NLP / imagecode
  Code and data for ImageCoDe, a contextual vison-and-language benchmark
  ☆39Updated last year
• e-bug / cross-modal-ablation
  [EMNLP 2021] Code and data for our paper "Vision-and-Language or Vision-for-Language? On Cross-Modal Influence in Multimodal Transformers…
  ☆20Updated 3 years ago
• salesforce / VD-BERT
  ☆44Updated 2 years ago
• redcaps-dataset / redcaps-downloader
  Command-line tool for downloading and extending the RedCaps dataset.
  ☆46Updated last year
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆45Updated 2 years ago
• aakashrkaku / intermdiate_layer_matter_ssl
  The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.
  ☆40Updated 2 years ago
• google-research / head2toe
  ☆81Updated 8 months ago
• MLforHealth / S2SD
  (ICML 2021) Implementation for S2SD - Simultaneous Similarity-based Self-Distillation for Deep Metric Learning. Paper Link: https://arxiv…
  ☆42Updated 4 years ago
• BierOne / Attention-Faithfulness
  [ICML 2022] This is the pytorch implementation of "Rethinking Attention-Model Explainability through Faithfulness Violation Test" (https:…
  ☆19Updated 2 years ago
• Weixin-Liang / MetaShift
  MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)
  ☆109Updated 2 years ago