captanlevi / Meaning-guided-video-captioning-
Here we describe a new approach to train a video captioning neural network , that is not only based on the normal cross entropy loss for the caption but also uses the meaning of the caption.
☆8Updated 4 years ago
Related projects: ⓘ
- ☆33Updated this week
- video captioning☆24Updated 5 years ago
- Implementation of "Watch, Listen, and Describe: Globally and Locally Aligned Cross-Modal Attentions for Video Captioning" (https://arxiv.…☆26Updated 5 years ago
- Dense video captioning in PyTorch☆41Updated 5 years ago
- Adversarial Inference for Multi-Sentence Video Descriptions (CVPR 2019)☆34Updated 5 years ago
- Official Tensorflow Implementation of the AAAI-2020 paper "Temporally Grounding Language Queries in Videos by Contextual Boundary-aware P…☆60Updated last year
- Code and Models for paper "Reinforced Video Captioning with Entailment Rewards (EMNLP 2017)"☆43Updated 4 years ago
- ☆34Updated this week
- Source code of the paper titled *Attentive Visual Semantic Specialized Network for Video Captioning*☆15Updated 3 years ago
- Implementation for "Joint Event Detection and Description in Continuous Video Streams"☆22Updated 3 years ago
- ☆31Updated 5 years ago
- Feature Extraction Toolbox from CUHKÐZ&SIAT submission to ActivityNet 2016☆33Updated 5 years ago
- Connective Cognition Network for Directional Visual Commonsense Reasoning☆15Updated 3 years ago
- PyTorch implementation of "TALL: Temporal Activity Localization via Language Query. Gao et al. ICCV2017."☆13Updated 5 years ago
- Codebase for CVPR 2020 paper "Spatio-Temporal Graph for Video Captioning with Knowledge Distillation"☆22Updated 4 years ago
- Source code for "Weakly-Supervised Video Object Grounding from Text by Loss Weighting and Object Interaction"☆44Updated 2 months ago
- Pytorch implementation of audio-visual fusion video captioning model☆25Updated 6 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- The code repository for "Cross-Modal and Hierarchical Modeling of Video and Text" in PyTorch☆16Updated 5 years ago
- Implementation for "Multilevel Language and Vision Integration for Text-to-Clip Retrieval"☆47Updated 5 years ago
- PyTorch code for: Learning to Generate Grounded Visual Captions without Localization Supervision☆44Updated 4 years ago
- Video captioning baseline models on Video2Commonsense Dataset.☆56Updated 3 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆87Updated last year
- Evaluation code for Dense-Captioning Events in Videos☆120Updated 5 years ago
- Source code for paper "Towards Automatic Learning of Procedures from Web Instructional Videos"☆34Updated 5 years ago
- Joint Embedding with Multimodal Cues for Cross-Modal Video-Text Retrieval☆69Updated 4 years ago
- implement video caption based on openNMT☆36Updated 6 years ago
- Video to Language Challenge (MSR-VTT Challenge 2016)☆32Updated 6 years ago
- Word2VisualVec : Predicting Visual Features from Text for Image and Video Caption Retrieval☆69Updated 4 years ago
- ☆41Updated 3 years ago