tezansahu / VQA-With-Multimodal-Transformers

Related projects ⓘ

Alternatives and complementary repositories for VQA-With-Multimodal-Transformers

• ntusteeian / VQA_CNN-LSTM
  Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…
  ☆17Updated 4 years ago
• RoyalSkye / Image-Caption
  Using LSTM or Transformer to solve Image Captioning in Pytorch
  ☆75Updated 3 years ago
• zarzouram / image_captioning_with_transformers
  Pytorch implementation of image captioning using transformer-based model.
  ☆61Updated last year
• abachaa / VQA-Med-2020
  VQA-Med 2020
  ☆13Updated last year
• tbmoon / basic_vqa
  Pytorch VQA : Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf)
  ☆95Updated last year
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated last year
• multimodal / multimodal
  A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"
  ☆79Updated 2 years ago
• SatyamGaba / visual_question_answering
  Visual Question Answering in PyTorch with various Attention Models
  ☆20Updated 4 years ago
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆44Updated 9 months ago
• milkymap / transformer-image-captioning
  Implementation of the paper CPTR : FULL TRANSFORMER NETWORK FOR IMAGE CAPTIONING
  ☆27Updated 2 years ago
• gchhablani / multilingual-vqa
  Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.
  ☆34Updated 3 years ago
• Taaccoo / awesome-vqa-latest
  Visual Question Answering Paper List.
  ☆51Updated 2 years ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆117Updated last year
• yikuan8 / Transformers-VQA
  An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER
  ☆163Updated last year
• aravindvarier / Image-Captioning-Pytorch
  Hyperparameter analysis for Image Captioning using LSTMs and Transformers
  ☆27Updated last year
• google-deepmind / multimodal_transformers
  ☆63Updated 2 years ago
• HimariO / HatefulMemesChallenge
  ☆91Updated last year
• Dong-JinKim / DenseRelationalCaptioning
  Code of Dense Relational Captioning
  ☆67Updated last year
• PaulCCCCCCH / Multimodal-Categorization-of-Crisis-Events-in-Social-Media
  An unofficial implementation of the CVPR 2020 paper Multimodal Categorization of Crisis Events in Social Media
  ☆12Updated 2 years ago
• RachanaJayaram / Cross-Attention-VizWiz-VQA
  A self-evident application of the VQA task is to design systems that aid blind people with sight reliant queries. The VizWiz VQA dataset …
  ☆14Updated 11 months ago
• aditya10 / VLC-BERT
  Code for WACV 2023 paper "VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge"
  ☆21Updated last year
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆185Updated last year
• drivendataorg / hateful-memes
  ☆58Updated last year
• rizavelioglu / hateful_memes-hate_detectron
  Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge. https://arxi…
  ☆54Updated 9 months ago
• zinengtang / TVLT
  PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)
  ☆120Updated last year
• tanishqgautam / Image-Captioning
  Implemented 3 different architectures to tackle the Image Caption problem, i.e, Merged Encoder-Decoder - Bahdanau Attention - Transformer…
  ☆41Updated 3 years ago
• gokulkarthik / hateclipper
  Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…
  ☆42Updated last year
• microsoft / PICa
  An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)
  ☆84Updated 2 years ago
• bearcatt / LaBERT
  A length-controllable and non-autoregressive image captioning model.
  ☆66Updated 3 years ago