Alternatives and similar repositories for VQA-With-Multimodal-Transformers:

Users that are interested in VQA-With-Multimodal-Transformers are comparing it to the libraries listed below

• ntusteeian / VQA_CNN-LSTM
  Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…
  ☆18Updated 4 years ago
• abachaa / VQA-Med-2020
  VQA-Med 2020
  ☆14Updated 2 years ago
• zarzouram / image_captioning_with_transformers
  Pytorch implementation of image captioning using transformer-based model.
  ☆62Updated last year
• RoyalSkye / Image-Caption
  Using LSTM or Transformer to solve Image Captioning in Pytorch
  ☆76Updated 3 years ago
• microsoft / PICa
  An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)
  ☆85Updated 2 years ago
• aravindvarier / Image-Captioning-Pytorch
  Hyperparameter analysis for Image Captioning using LSTMs and Transformers
  ☆26Updated last year
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated last year
• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆81Updated 3 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 3 years ago
• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆47Updated 2 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• inuwamobarak / Image-captioning-ViT
  Image Captioning Vision Transformers (ViTs) are transformer models that generate descriptive captions for images by combining the power o…
  ☆29Updated 4 months ago
• apsdehal / flava-tutorials
  Tutorials for FLAVA model https://arxiv.org/abs/2112.04482
  ☆12Updated 2 years ago
• VirajBagal / MMBERT
  MMBERT: Multimodal BERT Pretraining for Improved Medical VQA
  ☆35Updated 3 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆191Updated last year
• zjukg / Structure-CLIP
  [Paper][AAAI2024]Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
  ☆131Updated 8 months ago
• tbmoon / basic_vqa
  Pytorch VQA : Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf)
  ☆96Updated last year
• aditya10 / VLC-BERT
  Code for WACV 2023 paper "VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge"
  ☆21Updated last year
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆188Updated last year
• 232525 / PureT
  Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]
  ☆67Updated 9 months ago
• ilkerkesen / frozen
  A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.
  ☆45Updated 2 years ago
• rentainhe / TRAR-VQA
  [ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"
  ☆66Updated 3 years ago
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆71Updated last year
• jchenghu / ExpansionNet_v2
  Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"
  ☆86Updated 2 months ago
• ThalesGroup / ConceptBERT
  Implementation of ConceptBert: Concept-Aware Representation for Visual Question Answering
  ☆29Updated 10 months ago
• yrcong / RelTR
  RelTR: Relation Transformer for Scene Graph Generation: https://arxiv.org/abs/2201.11460v2
  ☆265Updated 6 months ago
• yahoo / object_relation_transformer
  Implementation of the Object Relation Transformer for Image Captioning
  ☆177Updated 5 months ago
• YulongBonjour / SimVLM
  SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION
  ☆36Updated 2 years ago
• milkymap / transformer-image-captioning
  Implementation of the paper CPTR : FULL TRANSFORMER NETWORK FOR IMAGE CAPTIONING
  ☆28Updated 2 years ago
• jylins / videoxum
  [TMM 2023] VideoXum: Cross-modal Visual and Textural Summarization of Videos
  ☆41Updated 10 months ago