MILVLG / rosita
ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
☆56Updated last year
Alternatives and similar repositories for rosita:
Users that are interested in rosita are comparing it to the libraries listed below
- Human-like Controllable Image Captioning with Verb-specific Semantic Roles.☆36Updated 3 years ago
- ☆63Updated 3 years ago
- A reading list of papers about Visual Question Answering.☆32Updated 2 years ago
- ☆25Updated 2 years ago
- ☆28Updated 2 years ago
- Codes for paper "Towards Diverse Paragraph Captioning for Untrimmed Videos". CVPR 2021☆66Updated 3 years ago
- Counterfactual Samples Synthesizing for Robust VQA☆77Updated 2 years ago
- Code for WACV 2021 Paper "Meta Module Network for Compositional Visual Reasoning"☆43Updated 3 years ago
- Starter Code for VALUE benchmark☆80Updated 2 years ago
- Implementation for MAF: Multimodal Alignment Framework☆46Updated 4 years ago
- ☆32Updated 3 years ago
- The source code of ACL 2020 paper: "Cross-Modality Relevance for Reasoning on Language and Vision"☆27Updated 3 years ago
- Code for Greedy Gradient Ensemble for Visual Question Answering （ICCV 2021, Oral）☆26Updated 3 years ago
- CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment☆22Updated 2 years ago
- Improving One-stage Visual Grounding by Recursive Sub-query Construction, ECCV 2020☆85Updated 3 years ago
- ☆26Updated 3 years ago
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆48Updated 2 years ago
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）☆65Updated 4 years ago
- Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…☆119Updated 4 years ago
- Video Graph Transformer for Video Question Answering (ECCV'22)☆47Updated last year
- A weakly-supervised scene graph generation codebase. The implementation of our CVPR2021 paper ``Linguistic Structures as Weak Supervision…☆37Updated 3 years ago
- [AAAI'20] Code release for "HAL: Improved Text-Image Matching by Mitigating Visual Semantic Hubs".☆37Updated last year
- ☆22Updated 3 years ago
- Compact Trilinear Interaction for Visual Question Answering (ICCV 2019)☆38Updated 2 years ago
- Learning phrase grounding from captioned images through InfoNCE bound on mutual information☆73Updated 4 years ago
- Official code for paper "Spatially Aware Multimodal Transformers for TextVQA" published at ECCV, 2020.☆64Updated 3 years ago
- ☆38Updated 2 years ago
- Diverse Image Captioning with Context-Object Split Latent Spaces (NeurIPS 2020)☆37Updated 2 years ago
- Data Release for VALUE Benchmark☆31Updated 3 years ago
- sairin1202 / Commonsense-Knowledge-Aware-Concept-Selection-For-Diverse-and-Informative-Visual-StorytellingThe implement of Commonsense Knowledge Aware Concept Selection For Diverse and Informative Visual Storytelling☆11Updated 3 years ago