Alternatives and similar repositories for VQA-With-Multimodal-Transformers

Users that are interested in VQA-With-Multimodal-Transformers are comparing it to the libraries listed below

• ntusteeian / VQA_CNN-LSTM
  Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…
  ☆20Updated 4 years ago
• microsoft / PICa
  An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)
  ☆85Updated 3 years ago
• apsdehal / flava-tutorials
  Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
  ☆12Updated 3 years ago
• abachaa / VQA-Med-2020
  VQA-Med 2020
  ☆14Updated 2 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 3 years ago
• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆82Updated 3 years ago
• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆52Updated 2 months ago
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated 2 years ago
• numanai / Visual-Question-Answering-for-Medical-domain
  ☆11Updated last year
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆197Updated last year
• yikuan8 / Transformers-VQA
  An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER
  ☆164Updated 2 years ago
• zarzouram / image_captioning_with_transformers
  Pytorch implementation of image captioning using transformer-based model.
  ☆66Updated 2 years ago
• RoyalSkye / Image-Caption
  Using LSTM or Transformer to solve Image Captioning in Pytorch
  ☆78Updated 3 years ago
• VirajBagal / MMBERT
  MMBERT: Multimodal BERT Pretraining for Improved Medical VQA
  ☆38Updated 4 years ago
• HimariO / HatefulMemesChallenge
  ☆93Updated 2 years ago
• aditya10 / VLC-BERT
  Code for WACV 2023 paper "VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge"
  ☆21Updated 2 years ago
• aravindvarier / Image-Captioning-Pytorch
  Hyperparameter analysis for Image Captioning using LSTMs and Transformers
  ☆26Updated last year
• SatyamGaba / visual_question_answering
  Visual Question Answering in PyTorch with various Attention Models
  ☆20Updated 5 years ago
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆76Updated last week
• artelab / Image-and-Text-fusion-for-UPMC-Food-101-using-BERT-and-CNNs
  ☆60Updated 4 years ago
• dino-chiio / blip-vqa-finetune
  This is implementation of finetuning BLIP model for Visual Question Answering
  ☆72Updated last year
• sergiotasconmorales / consistency_vqa
  Repository of paper Consistency-preserving Visual Question Answering in Medical Imaging (MICCAI2022)
  ☆23Updated 2 years ago
• zinengtang / TVLT
  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
  ☆125Updated 2 years ago
• ExplainableML / CLEVR-X
  CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations
  ☆28Updated last year
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆371Updated last year
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆224Updated 3 years ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆122Updated last year
• YoadTew / zero-shot-image-to-text
  Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
  ☆276Updated 2 years ago
• AndersonStra / MuKEA
  MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering
  ☆96Updated 2 years ago