tezansahu / VQA-With-Multimodal-Transformers
Exploring multimodal fusion-type transformer models for visual question answering (on DAQUAR dataset)
☆33Updated 2 years ago
Related projects: ⓘ
- Pytorch implementation of image captioning using transformer-based model.☆57Updated last year
- Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…☆16Updated 4 years ago
- Hate-CLIPper: Multimodal Hateful Meme Classification with Explicit Cross-modal Interaction of CLIP features - Accepted at EMNLP 2022 Work…☆40Updated last year
- In-the-wild Question Answering☆15Updated last year
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 3 years ago
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆78Updated 2 years ago
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆65Updated 11 months ago
- Implementation of the paper CPTR : FULL TRANSFORMER NETWORK FOR IMAGE CAPTIONING☆26Updated 2 years ago
- ☆74Updated this week
- NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)☆44Updated 7 months ago
- [TMLR 2022] High-Modality Multimodal Transformer☆104Updated 11 months ago
- ☆56Updated 3 years ago
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆87Updated 3 weeks ago
- GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)☆177Updated last year
- Using LSTM or Transformer to solve Image Captioning in Pytorch☆73Updated 3 years ago
- Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"☆83Updated 4 months ago
- Visual Question Answering Paper List.☆51Updated 2 years ago
- This is implementation of finetuning BLIP model for Visual Question Answering☆42Updated 8 months ago
- An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA, AAAI 2022 (Oral)☆83Updated 2 years ago
- Hyperparameter analysis for Image Captioning using LSTMs and Transformers☆27Updated 11 months ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER☆162Updated last year
- Code for WACV 2023 paper "VLC-BERT: Visual Question Answering with Contextualized Commonsense Knowledge"☆21Updated last year
- Transformer & CNN Image Captioning model in PyTorch.☆40Updated last year
- Code and data for ImageCoDe, a contextual vison-and-language benchmark☆39Updated 6 months ago
- An easy to use, user-friendly and efficient code for extracting OpenAI CLIP (Global/Grid) features from image and text respectively.☆104Updated 2 years ago
- ☆62Updated 2 years ago
- SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION☆34Updated last year
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆181Updated 7 months ago
- This is the official implementation of the paper "MM-SHAP: A Performance-agnostic Metric for Measuring Multimodal Contributions in Vision…☆19Updated 6 months ago
- Visual Question Answering in PyTorch with various Attention Models☆19Updated 4 years ago