noagarcia / knowit-rock
ROCK model for Knowledge-Based VQA in Videos
☆31Updated 4 years ago
Alternatives and similar repositories for knowit-rock:
Users that are interested in knowit-rock are comparing it to the libraries listed below
- BottomUpTopDown VQA model with question-type debiasing☆22Updated 5 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- ☆15Updated 4 years ago
- The source code of ACL 2020 paper: "Cross-Modality Relevance for Reasoning on Language and Vision"☆27Updated 3 years ago
- Compact Trilinear Interaction for Visual Question Answering (ICCV 2019)☆38Updated 2 years ago
- PyTorch code for ROLL, a knowledge-based video story question answering model.☆21Updated 4 years ago
- ICCV2019: Controllable Video Captioning with POS Sequence Guidance Based on Gated Fusion Network☆67Updated 5 years ago
- Counterfactual Samples Synthesizing for Robust VQA☆78Updated 2 years ago
- This is the implementation of self-CIDEr and LSA-based diversity metrics (only for python 2.7).☆36Updated 3 years ago
- Code release for Learning to Assemble Neural Module Tree Networks for Visual Grounding (ICCV 2019)☆39Updated 5 years ago
- Implementation for the paper "Hierarchical Conditional Relation Networks for Video Question Answering" (Le et al., CVPR 2020, Oral)☆133Updated 8 months ago
- [CVPR20] Video Object Grounding using Semantic Roles in Language Description (https://arxiv.org/abs/2003.10606)☆67Updated 4 years ago
- Implementation of the EMNLP 2018 paper "Temporally Grounding Natural Sentence in Video" using PyTorch☆2Updated 2 years ago
- pytorch implementation for the paper Attend What You Need: Motion-Appearance Synergistic Networks for Video Question Answering☆2Updated 3 years ago
- ☆38Updated 2 years ago
- Heterogeneous Memory Enhanced Multimodal Attention Model for VideoQA☆54Updated 3 years ago
- Code release for Context-Aware Visual Policy Network for Sequence-Level Image Captioning (MM 2018) and Context-Aware Visual Policy Networ…☆46Updated 5 years ago
- ☆15Updated 8 months ago
- Code for NeurIPS 2019 paper ``Self-Critical Reasoning for Robust Visual Question Answering''☆39Updated 5 years ago
- Adversarial Inference for Multi-Sentence Video Descriptions (CVPR 2019)☆34Updated 5 years ago
- Implementation for MAF: Multimodal Alignment Framework☆46Updated 4 years ago
- [ECCV 2020] Official code for "Comprehensive Image Captioning via Scene Graph Decomposition"☆97Updated 8 months ago
- Pytorch implementation of "Explainable and Explicit Visual Reasoning over Scene Graphs "☆94Updated 6 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆90Updated last year
- [ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering☆129Updated 2 years ago
- PyTorch implementation of L-GCN [https://arxiv.org/abs/2008.09105]☆25Updated 3 years ago
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）☆65Updated 4 years ago
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆48Updated 2 years ago
- vqa drived by bottom-up and top-down attention and knowledge☆14Updated 6 years ago
- The code repository for "Cross-Modal and Hierarchical Modeling of Video and Text" in PyTorch☆16Updated 5 years ago