tezansahu / VQA-With-Multimodal-TransformersLinks
Exploring multimodal fusion-type transformer models for visual question answering (on DAQUAR dataset)
☆37Updated 3 years ago
Alternatives and similar repositories for VQA-With-Multimodal-Transformers
Users that are interested in VQA-With-Multimodal-Transformers are comparing it to the libraries listed below
Sorting:
- Pytorch implementation of VQA: Visual Question Answering (https://arxiv.org/pdf/1505.00468.pdf) using VQA v2.0 dataset for open-ended ta…☆20Updated 5 years ago
- Repository for Multilingual-VQA task created during HuggingFace JAX/Flax community week.☆34Updated 4 years ago
- In-the-wild Question Answering☆15Updated 2 years ago
- A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"☆83Updated 3 years ago
- Visual Question Answering in PyTorch with various Attention Models☆20Updated 5 years ago
- Pytorch implementation of image captioning using transformer-based model.☆68Updated 2 years ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER☆165Updated 2 years ago
- NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)☆48Updated last year
- This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…☆81Updated 4 months ago
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆198Updated last year
- 🥶Vilio: State-of-the-art VL models in PyTorch & PaddlePaddle☆90Updated 2 years ago
- VQA-Med 2020☆14Updated 2 years ago
- A curated list of vision-and-language pre-training (VLP). :-)☆59Updated 3 years ago
- Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic☆279Updated 3 years ago
- ☆63Updated 4 years ago
- Hyperparameter analysis for Image Captioning using LSTMs and Transformers☆26Updated 2 years ago
- ☆93Updated last year
- The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-languag…☆229Updated 3 years ago
- CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations☆29Updated last year
- ☆84Updated 2 years ago
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆97Updated last year
- CLIPxGPT Captioner is Image Captioning Model based on OpenAI's CLIP and GPT-2.☆118Updated 8 months ago
- ☆64Updated 3 years ago
- Chart-to-Text: Generating Natural Language Explanations for Charts by Adapting the Transformer Model☆156Updated 2 years ago
- Research code for "KAT: A Knowledge Augmented Transformer for Vision-and-Language"☆68Updated 3 years ago
- PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)☆246Updated 4 months ago
- A collection of models for image<->text generation in ACM MM 2021.☆67Updated 3 years ago
- ☆93Updated 2 years ago
- RelTR: Relation Transformer for Scene Graph Generation: https://arxiv.org/abs/2201.11460v2☆291Updated last year
- Tutorials for FLAVA model https://arxiv.org/abs/2112.04482☆12Updated 3 years ago