RachanaJayaram / Cross-Attention-VizWiz-VQA
A self-evident application of the VQA task is to design systems that aid blind people with sight reliant queries. The VizWiz VQA dataset originates from images and questions compiled by members of the visually impaired community and as such, highlights some of the challenges presented by this particular use case.
☆15Updated last year
Alternatives and similar repositories for Cross-Attention-VizWiz-VQA:
Users that are interested in Cross-Attention-VizWiz-VQA are comparing it to the libraries listed below
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" (NeurIPS 2019)☆65Updated 4 years ago
- Code of Dense Relational Captioning☆69Updated 2 years ago
- ☆38Updated 2 years ago
- The source code of ACL 2020 paper: "Cross-Modality Relevance for Reasoning on Language and Vision"☆27Updated 3 years ago
- Implementation for MAF: Multimodal Alignment Framework☆46Updated 4 years ago
- Unpaired Image Captioning☆35Updated 4 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020☆80Updated 4 years ago
- ROCK model for Knowledge-Based VQA in Videos☆30Updated 4 years ago
- ☆67Updated 2 years ago
- Microsoft COCO Caption Evaluation Tool - Python 3☆33Updated 5 years ago
- [CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias☆120Updated 3 years ago
- Implementation of paper "Improving Image Captioning with Better Use of Caption"☆32Updated 4 years ago
- A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning☆25Updated 4 years ago
- CNN+LSTM, Attention based, and MUTAN-based models for Visual Question Answering☆74Updated 5 years ago
- Code for paper "Adaptively Aligned Image Captioning via Adaptive Attention Time". NeurIPS 2019☆50Updated 5 years ago
- Compact Trilinear Interaction for Visual Question Answering (ICCV 2019)☆38Updated 2 years ago
- ☆63Updated 3 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''☆36Updated 3 years ago
- [EMNLP 2018] Training for Diversity in Image Paragraph Captioning☆89Updated 5 years ago
- [CVPR 2020] Transform and Tell: Entity-Aware News Image Captioning☆90Updated 11 months ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": LXMERT…☆21Updated 4 years ago
- Bottom-up features extractor implemented in PyTorch.☆71Updated 5 years ago
- ☆10Updated 6 years ago
- Human-like Controllable Image Captioning with Verb-specific Semantic Roles.☆36Updated 3 years ago
- ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration☆56Updated last year
- An image-oriented evaluation tool for image captioning systems (EMNLP-IJCNLP 2019)☆37Updated 4 years ago
- Code for our IJCAI2020 paper: Overcoming Language Priors with Self-supervised Learning for Visual Question Answering☆50Updated 4 years ago
- An implementation that downstreams pre-trained V+L models to VQA tasks. Now support: VisualBERT, LXMERT, and UNITER☆163Updated 2 years ago
- Code for "On diversity in image captioning: metrics and methods".☆8Updated 4 years ago