Alternatives and similar repositories for VQA-With-Multimodal-Transformers

Users that are interested in VQA-With-Multimodal-Transformers are comparing it to the libraries listed below

• ntusteeian / VQA_CNN-LSTM
  Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…
  ☆20Updated 5 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 4 years ago
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated 2 years ago
• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆83Updated 3 years ago
• SatyamGaba / visual_question_answering
  Visual Question Answering in PyTorch with various Attention Models
  ☆20Updated 5 years ago
• zarzouram / image_captioning_with_transformers
  Pytorch implementation of image captioning using transformer-based model.
  ☆68Updated 2 years ago
• yikuan8 / Transformers-VQA
  An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER
  ☆165Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆81Updated 4 months ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆198Updated last year
• Muennighoff / vilio
  🥶Vilio: State-of-the-art VL models in PyTorch & PaddlePaddle
  ☆90Updated 2 years ago
• abachaa / VQA-Med-2020
  VQA-Med 2020
  ☆14Updated 2 years ago
• zhjohnchan / awesome-vision-and-language-pretraining
  A curated list of vision-and-language pre-training (VLP). :-)
  ☆59Updated 3 years ago
• YoadTew / zero-shot-image-to-text
  Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
  ☆279Updated 3 years ago
• artelab / Image-and-Text-fusion-for-UPMC-Food-101-using-BERT-and-CNNs
  ☆63Updated 4 years ago
• aravindvarier / Image-Captioning-Pytorch
  Hyperparameter analysis for Image Captioning using LSTMs and Transformers
  ☆26Updated 2 years ago
• CMU-MultiComp-Lab / mmml-course
  ☆93Updated last year
• junchen14 / Multi-Modal-Transformer
  The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-languag…
  ☆229Updated 3 years ago
• ExplainableML / CLEVR-X
  CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations
  ☆29Updated last year
• sanjayss34 / codevqa
  ☆84Updated 2 years ago
• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆97Updated last year
• jmisilo / clip-gpt-captioning
  CLIPxGPT Captioner is Image Captioning Model based on OpenAI's CLIP and GPT-2.
  ☆118Updated 8 months ago
• google-deepmind / multimodal_transformers
  ☆64Updated 3 years ago
• JasonObeid / Chart2Text
  Chart-to-Text: Generating Natural Language Explanations for Charts by Adapting the Transformer Model
  ☆156Updated 2 years ago
• guilk / KAT
  Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"
  ☆68Updated 3 years ago
• j-min / CLIP-Caption-Reward
  PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
  ☆246Updated 4 months ago
• researchmm / generate-it
  A collection of models for image<->text generation in ACM MM 2021.
  ☆67Updated 3 years ago
• HimariO / HatefulMemesChallenge
  ☆93Updated 2 years ago
• yrcong / RelTR
  RelTR: Relation Transformer for Scene Graph Generation: https://arxiv.org/abs/2201.11460v2
  ☆291Updated last year
• apsdehal / flava-tutorials
  Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
  ☆12Updated 3 years ago