Alternatives and similar repositories for VQA-With-Multimodal-Transformers:

Users that are interested in VQA-With-Multimodal-Transformers are comparing it to the libraries listed below

• ntusteeian / VQA_CNN-LSTM
  Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…
  ☆17Updated 4 years ago
• yikuan8 / Transformers-VQA
  An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER
  ☆163Updated 2 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 3 years ago
• zarzouram / image_captioning_with_transformers
  Pytorch implementation of image captioning using transformer-based model.
  ☆62Updated last year
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆189Updated last year
• RoyalSkye / Image-Caption
  Using LSTM or Transformer to solve Image Captioning in Pytorch
  ☆76Updated 3 years ago
• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆81Updated 2 years ago
• abachaa / VQA-Med-2020
  VQA-Med 2020
  ☆13Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆45Updated last year
• tbmoon / basic_vqa
  Pytorch VQA : Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf)
  ☆95Updated last year
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆185Updated last year
• Taaccoo / awesome-vqa-latest
  Visual Question Answering Paper List.
  ☆53Updated 2 years ago
• milkymap / transformer-image-captioning
  Implementation of the paper CPTR : FULL TRANSFORMER NETWORK FOR IMAGE CAPTIONING
  ☆28Updated 2 years ago
• VirajBagal / MMBERT
  MMBERT: Multimodal BERT Pretraining for Improved Medical VQA
  ☆35Updated 3 years ago
• aravindvarier / Image-Captioning-Pytorch
  Hyperparameter analysis for Image Captioning using LSTMs and Transformers
  ☆26Updated last year
• bearcatt / LaBERT
  A length-controllable and non-autoregressive image captioning model.
  ☆68Updated 3 years ago
• apsdehal / flava-tutorials
  Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
  ☆12Updated 2 years ago
• numanai / Visual-Question-Answering-for-Medical-domain
  ☆11Updated 10 months ago
• tanishqgautam / Image-Captioning
  Implemented 3 different architectures to tackle the Image Caption problem, i.e, Merged Encoder-Decoder - Bahdanau Attention - Transformer…
  ☆41Updated 3 years ago
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated last year
• microsoft / PICa
  An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)
  ☆85Updated 2 years ago
• abachaa / VQA-Med-2019
  Visual Question Answering in the Medical Domain VQA-Med 2019
  ☆84Updated last year
• microsoft / scene_graph_benchmark
  image scene graph generation benchmark
  ☆394Updated 2 years ago
• artelab / Image-and-Text-fusion-for-UPMC-Food-101-using-BERT-and-CNNs
  ☆58Updated 3 years ago
• salaniz / pycocoevalcap
  Python 3 support for the MS COCO caption evaluation tools
  ☆310Updated 5 months ago
• sarahESL / PubMedCLIP
  Fine-tuning CLIP using ROCO dataset which contains image-caption pairs from PubMed articles.
  ☆149Updated 5 months ago
• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆46Updated last year
• airsplay / py-bottom-up-attention
  PyTorch bottom-up attention with Detectron2
  ☆231Updated 3 years ago
• SatyamGaba / visual_question_answering
  Visual Question Answering in PyTorch with various Attention Models
  ☆20Updated 4 years ago
• omar-mohamed / GPT2-Chest-X-Ray-Report-Generation
  This is the implementation of the CDGPT2 model mentioned in our paper 'Automated Radiology Report Generation using Conditioned Transforme…
  ☆78Updated 6 months ago