qinzzz / Multimodal-Alignment-Framework
Implementation for MAF: Multimodal Alignment Framework
☆43Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for Multimodal-Alignment-Framework
- Learning phrase grounding from captioned images through InfoNCE bound on mutual information☆72Updated 4 years ago
- Improving One-stage Visual Grounding by Recursive Sub-query Construction, ECCV 2020☆82Updated 3 years ago
- ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration☆56Updated last year
- ☆62Updated 2 years ago
- Human-like Controllable Image Captioning with Verb-specific Semantic Roles.☆36Updated 2 years ago
- Unpaired Image Captioning☆35Updated 3 years ago
- Starter Code for VALUE benchmark☆79Updated 2 years ago
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）☆64Updated 4 years ago
- The source code of ACL 2020 paper: "Cross-Modality Relevance for Reasoning on Language and Vision"☆26Updated 3 years ago
- Compact Trilinear Interaction for Visual Question Answering (ICCV 2019)☆38Updated last year
- Code release for Learning to Assemble Neural Module Tree Networks for Visual Grounding (ICCV 2019)☆37Updated 4 years ago
- A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning☆24Updated 4 years ago
- A video retrieval dataset How2R and a video QA dataset How2QA☆24Updated 4 years ago
- A Fast and Accurate One-Stage Approach to Visual Grounding, ICCV 2019 (Oral)☆144Updated 3 years ago
- The code repository for "Cross-Modal and Hierarchical Modeling of Video and Text" in PyTorch☆16Updated 5 years ago
- Counterfactual Samples Synthesizing for Robust VQA☆76Updated last year
- [ACL 2020] PyTorch code for TVQA+: Spatio-Temporal Grounding for Video Question Answering☆123Updated 2 years ago
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆48Updated 2 years ago
- A collections of papers about VQA-CP datasets and their results☆37Updated 2 years ago
- Official codebase for "Ref-NMS: Breaking Proposal Bottlenecks in Two-Stage Referring Expression Grounding"☆21Updated 3 years ago
- Data Release for VALUE Benchmark☆31Updated 2 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- CVPR 2021 Official Pytorch Code for UC2: Universal Cross-lingual Cross-modal Vision-and-Language Pre-training☆34Updated 3 years ago
- Code for Greedy Gradient Ensemble for Visual Question Answering （ICCV 2021, Oral）☆25Updated 2 years ago
- This is the repo for Multi-level textual grounding☆33Updated 4 years ago
- Pytorch implementation for our NeurIPS 2019 paper "TAB-VCR: Tags and Attributes based VCR Baselines" https://arxiv.org/abs/1910.14671☆19Updated 3 years ago
- Code for the paper "Controllable Video Captioning with an Exemplar Sentence"☆12Updated 3 years ago
- AAAI2020-The official implementation of "Learning Cross-modal Context Graph for Visual Grounding"☆57Updated 3 years ago
- PyTorch implementation of "Debiased Visual Question Answering from Feature and Sample Perspectives" (NeurIPS 2021)☆22Updated 2 years ago
- The codes and features of the re-implementation of SIGIR 2021 work "Deconfounded Video Moment Retrieval with Causal Intervention"☆35Updated 3 years ago