Alternatives and similar repositories for VQA-With-Multimodal-Transformers

Users that are interested in VQA-With-Multimodal-Transformers are comparing it to the libraries listed below

• ntusteeian / VQA_CNN-LSTM
  Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…
  ☆20Updated 5 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 4 years ago
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆80Updated 3 months ago
• zarzouram / image_captioning_with_transformers
  Pytorch implementation of image captioning using transformer-based model.
  ☆68Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆199Updated last year
• SatyamGaba / visual_question_answering
  Visual Question Answering in PyTorch with various Attention Models
  ☆20Updated 5 years ago
• apsdehal / flava-tutorials
  Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
  ☆12Updated 3 years ago
• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆53Updated 5 months ago
• aravindvarier / Image-Captioning-Pytorch
  Hyperparameter analysis for Image Captioning using LSTMs and Transformers
  ☆26Updated last year
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• google-deepmind / multimodal_transformers
  ☆65Updated 3 years ago
• michelecafagna26 / faster-rcnn-bottom-up-py
  Extract features and bounding boxes using the original Bottom-up Attention Faster-RCNN in a few lines of Python code
  ☆11Updated 3 years ago
• YulongBonjour / SimVLM
  SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION
  ☆36Updated 2 years ago
• tanishqgautam / Image-Captioning
  Implemented 3 different architectures to tackle the Image Caption problem, i.e, Merged Encoder-Decoder - Bahdanau Attention - Transformer…
  ☆40Updated 4 years ago
• keep-smile-001 / opentqa
  opentqa is a open framework of the textbook question answering, which includes xtqa, mcan, cmr, mfb, mutan.
  ☆11Updated 4 years ago
• saahiluppal / catr
  Image Captioning Using Transformer
  ☆271Updated 3 years ago
• aditya10 / VLC-BERT
  Code for WACV 2023 paper "VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge"
  ☆21Updated 2 years ago
• Toloka / WSDMCup2023
  Toloka Visual Question Answering Challenge at WSDM Cup 2023
  ☆31Updated last year
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆68Updated 3 years ago
• jchenghu / ExpansionNet_v2
  Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"
  ☆93Updated 9 months ago
• HimariO / HatefulMemesChallenge
  ☆93Updated 2 years ago
• abachaa / VQA-Med-2020
  VQA-Med 2020
  ☆14Updated 2 years ago
• junchen14 / Multi-Modal-Transformer
  The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-languag…
  ☆230Updated 3 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆195Updated 2 years ago
• pliang279 / HighMMT
  [TMLR 2022] High-Modality Multimodal Transformer
  ☆117Updated 10 months ago
• j-min / CLIP-Caption-Reward
  PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
  ☆246Updated 3 months ago
• Zasder3 / train-CLIP-FT
  ☆47Updated 4 years ago
• artelab / Image-and-Text-fusion-for-UPMC-Food-101-using-BERT-and-CNNs
  ☆63Updated 4 years ago
• RoyalSkye / Image-Caption
  Using LSTM or Transformer to solve Image Captioning in Pytorch
  ☆79Updated 4 years ago