google-deepmind / multimodal_transformers

Related projects ⓘ

Alternatives and complementary repositories for multimodal_transformers

• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆44Updated 9 months ago
• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆79Updated 2 years ago
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆86Updated last year
• pliang279 / HighMMT
  [TMLR 2022] High-Modality Multimodal Transformer
  ☆107Updated 2 weeks ago
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆32Updated last year
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆32Updated last year
• google-research / fnc
  ☆25Updated 3 years ago
• allenai / sherlock
  Code, data, models for the Sherlock corpus
  ☆55Updated 2 years ago
• salesforce / VD-BERT
  ☆44Updated 2 years ago
• itaigat / removing-bias-in-multi-modal-classifiers
  ☆30Updated 3 years ago
• e-bug / iglue
  [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"
  ☆49Updated last year
• McGill-NLP / imagecode
  Code and data for ImageCoDe, a contextual vison-and-language benchmark
  ☆39Updated 8 months ago
• yizhen-zhang / VG-Bert
  Codes and scripts for "Explainable Semantic Space by Grounding Languageto Vision with Cross-Modal Contrastive Learning"
  ☆21Updated 2 years ago
• Seth-Park / MultimodalExplanations
  Code release for Park et al. Multimodal Multimodal Explanations: Justifying Decisions and Pointing to the Evidence. in CVPR, 2018
  ☆49Updated 6 years ago
• facebookresearch / connect-caption-and-trace
  A unified framework to jointly model images, text, and human attention traces.
  ☆78Updated 3 years ago
• cdancette / detect-shortcuts
  Repo for ICCV 2021 paper: Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering
  ☆24Updated 4 months ago
• BierOne / Attention-Faithfulness
  [ICML 2022] This is the pytorch implementation of "Rethinking Attention-Model Explainability through Faithfulness Violation Test" (https:…
  ☆18Updated 2 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆223Updated 2 years ago
• redcaps-dataset / redcaps-downloader
  Command-line tool for downloading and extending the RedCaps dataset.
  ☆45Updated 11 months ago
• zinengtang / VidLanKD
  Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer (NeurIPS 2021))
  ☆56Updated last year
• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆92Updated 2 months ago
• allenai / gpv2
  ☆32Updated 2 years ago
• amazon-science / crossmodal-contrastive-learning
  CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021
  ☆57Updated 2 years ago
• LuoweiZhou / coco-caption
  kdexd/coco-caption@de6f385
  ☆26Updated 4 years ago
• mair-lab / mapl
  ☆29Updated last year
• goel-shashank / CyCLIP
  ☆113Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆202Updated last year
• MicPie / clasp
  CLASP - Contrastive Language-Aminoacid Sequence Pretraining
  ☆142Updated 3 years ago
• maximek3 / e-ViL
  ☆40Updated last year
• google / localized-narratives
  Localized Narratives
  ☆83Updated 3 years ago