MILVLG / mt-captioning
A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning
☆24Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for mt-captioning
- Implementation of paper "Improving Image Captioning with Better Use of Caption"☆32Updated 4 years ago
- Code for "Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representations" （NeurIPS 2019）☆64Updated 4 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- ☆62Updated 2 years ago
- Official pytorch implementation of the AAAI 2021 paper "Semantic Grouping Network for Video Captioning"☆52Updated 3 years ago
- Implementation for MAF: Multimodal Alignment Framework☆43Updated 3 years ago
- Human-like Controllable Image Captioning with Verb-specific Semantic Roles.☆36Updated 2 years ago
- Adversarial Inference for Multi-Sentence Video Descriptions (CVPR 2019)☆34Updated 5 years ago
- Deep Multimodal Neural Architecture Search☆26Updated 3 years ago
- ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration☆56Updated last year
- ☆65Updated last year
- Code for "On diversity in image captioning: metrics and methods".☆8Updated 4 years ago
- Compact Trilinear Interaction for Visual Question Answering (ICCV 2019)☆38Updated last year
- Microsoft COCO Caption Evaluation Tool - Python 3☆31Updated 5 years ago
- Source code of the paper titled *Improving Video Captioning with Temporal Composition of a Visual-Syntactic Embedding*☆29Updated 3 years ago
- Show, Edit and Tell: A Framework for Editing Image Captions, CVPR 2020☆81Updated 4 years ago
- Unpaired Image Captioning☆35Updated 3 years ago
- code for paper `MemCap: Memorizing Style Knowledge for Image Captioning`☆11Updated 4 years ago
- Code for paper "Adaptively Aligned Image Captioning via Adaptive Attention Time". NeurIPS 2019☆49Updated 4 years ago
- [ECCV 2020] Official code for "Comprehensive Image Captioning via Scene Graph Decomposition"☆96Updated 2 months ago
- Codebase for CVPR 2020 paper "Spatio-Temporal Graph for Video Captioning with Knowledge Distillation"☆23Updated 4 years ago
- Implementation of "Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning" (https://arxiv.…☆26Updated 6 years ago
- ☆37Updated 6 years ago
- This is the implementation of self-CIDEr and LSA-based diversity metrics (only for python 2.7).☆36Updated 2 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆88Updated last year
- Counterfactual Samples Synthesizing for Robust VQA☆76Updated last year
- ROCK model for Knowledge-Based VQA in Videos☆30Updated 4 years ago
- Starter code for the VMT task and challenge☆51Updated 4 years ago
- Code for the paper "Controllable Video Captioning with an Exemplar Sentence"☆12Updated 3 years ago
- Pytorch implementation for our NeurIPS 2019 paper "TAB-VCR: Tags and Attributes based VCR Baselines" https://arxiv.org/abs/1910.14671☆19Updated 3 years ago