noagarcia / knowit-rock
ROCK model for Knowledge-Based VQA in Videos
☆30Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for knowit-rock
- PyTorch code for ROLL, a knowledge-based video story question answering model.☆19Updated 4 years ago
- BottomUpTopDown VQA model with question-type debiasing☆23Updated 5 years ago
- Counterfactual Samples Synthesizing for Robust VQA☆76Updated last year
- [ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering☆123Updated 2 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- pytorch implementation for the paper Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering☆2Updated 3 years ago
- ☆15Updated 4 years ago
- Compact Trilinear Interaction for Visual Question Answering (ICCV 2019)☆38Updated last year
- ICCV2019: Controllable Video Captioning with POS Sequence Guidance Based on Gated Fusion Network☆67Updated 4 years ago
- Implementation of the EMNLP 2018 paper "Temporally Grounding Natural Sentence in Video" using PyTorch☆2Updated last year
- The source code of ACL 2020 paper: "Cross-Modality Relevance for Reasoning on Language and Vision"☆26Updated 3 years ago
- Code for NeurIPS 2019 paper ``Self-Critical Reasoning for Robust Visual Question Answering''☆40Updated 5 years ago
- The code repository for "Cross-Modal and Hierarchical Modeling of Video and Text" in PyTorch☆16Updated 5 years ago
- [ECCV 2020] Official code for "Comprehensive Image Captioning via Scene Graph Decomposition"☆96Updated 2 months ago
- Heterogeneous Memory Enhanced Multimodal Attention Model for VideoQA☆54Updated 3 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆88Updated last year
- ☆62Updated 2 years ago
- Pytorch implementation for our NeurIPS 2019 paper "TAB-VCR: Tags and Attributes based VCR Baselines" https://arxiv.org/abs/1910.14671☆19Updated 3 years ago
- This is the implementation of self-CIDEr and LSA-based diversity metrics (only for python 2.7).☆36Updated 2 years ago
- ☆15Updated 2 months ago
- [CVPR20] Video Object Grounding using Semantic Roles in Language Description (https://arxiv.org/abs/2003.10606)☆67Updated 4 years ago
- Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)☆131Updated 3 months ago
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" (NeurIPS 2019)☆64Updated 4 years ago
- ☆10Updated 2 years ago
- ☆39Updated last year
- Code release for Context-Aware Visual Policy Network for Sequence-Level Image Captioning (MM 2018) and Context-Aware Visual Policy Networ…☆47Updated 5 years ago
- A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning☆24Updated 4 years ago
- PyTorch implementation of L-GCN [https://arxiv.org/abs/2008.09105]☆25Updated 3 years ago