captanlevi / Meaning-guided-video-captioning-
Here we describe a new approach to train a video captioning neural network , that is not only based on the normal cross entropy loss for the caption but also uses the meaning of the caption.
☆8Updated 4 years ago
Alternatives and similar repositories for Meaning-guided-video-captioning-:
Users that are interested in Meaning-guided-video-captioning- are comparing it to the libraries listed below
- Adversarial Inference for Multi-Sentence Video Descriptions (CVPR 2019)☆34Updated 5 years ago
- Implementation of "Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning" (https://arxiv.…☆26Updated 6 years ago
- Official Tensorflow Implementation of the AAAI-2020 paper "Temporally Grounding Language Queries in Videos by Contextual Boundary-aware P…☆60Updated last year
- Code and Models for paper "Reinforced Video Captioning with Entailment Rewards (EMNLP 2017)"☆43Updated 5 years ago
- Dense video captioning in PyTorch☆41Updated 5 years ago
- Codebase for CVPR 2020 paper "Spatio-Temporal Graph for Video Captioning with Knowledge Distillation"☆23Updated 4 years ago
- video captioning☆24Updated 5 years ago
- Implementation for "Joint Event Detection and Description in Continuous Video Streams"☆22Updated 4 years ago
- PyTorch code for: Learning to Generate Grounded Visual Captions without Localization Supervision☆44Updated 4 years ago
- ☆31Updated 6 years ago
- The code repository for "Cross-Modal and Hierarchical Modeling of Video and Text" in PyTorch☆16Updated 5 years ago
- Feature Extraction Toolbox from CUHKÐZ&SIAT submission to ActivityNet 2016☆32Updated 5 years ago
- Rethinking the Form of Latent States in Image Captioning☆21Updated 6 years ago
- Source code for paper "Towards Automatic Learning of Procedures from Web Instructional Videos"☆34Updated 6 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- Source code for "Weakly-Supervised Video Object Grounding from Text by Loss Weighting and Object Interaction"☆44Updated 7 months ago
- Connective Cognition Network for Directional Visual Commonsense Reasoning☆15Updated 3 years ago
- Implementation for "Multilevel Language and Vision Integration for Text-to-Clip Retrieval"☆49Updated 6 years ago
- Word2VisualVec : Predicting Visual Features from Text for Image and Video Caption Retrieval☆69Updated 5 years ago
- Rethinking Diversified and Discriminative Proposal Generation for Visual Grounding☆22Updated 6 years ago
- Code for "On diversity in image captioning: metrics and methods".☆8Updated 4 years ago
- Source code of the paper titled *Improving Video Captioning with Temporal Composition of a Visual-Syntactic Embedding*☆30Updated 3 years ago
- Code for the Visual Question Answering (VQA) part of CVPR 2019 oral paper: "Learning to Compose Dynamic Tree Structures for Visual Contex…☆35Updated 5 years ago
- Torch Implementation of Speaker-Listener-Reinforcer for Referring Expression Generation and Comprehension☆33Updated 6 years ago
- Weakly Supervised Dense Event Captioning in Videos, i.e. generating multiple sentence descriptions for a video in a weakly-supervised man…☆104Updated 4 years ago
- Joint Embedding with Multimodal Cues for Cross-Modal Video-Text Retrieval☆67Updated 4 years ago
- Inferring and Executing Programs for Visual Reasoning☆21Updated 6 years ago
- Starter code for the VMT task and challenge☆51Updated 4 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆89Updated last year
- Video captioning baseline models on Video2Commonsense Dataset.☆57Updated 3 years ago