passerby233 / Collection-of-Visual-Storytelling-StoryNLP
This repository aims to collect the articles and codes for the Visual Storytelling (VIST) task. VIST is a vision-and-language task. It aims to summarize the idea of a photo stream and tells a story about it (in natural language). Be careful about its difference from the "storytelling with data", which is more related to data visualization.
☆21Updated 4 years ago
Alternatives and similar repositories for Collection-of-Visual-Storytelling-StoryNLP:
Users that are interested in Collection-of-Visual-Storytelling-StoryNLP are comparing it to the libraries listed below
- Visual Storytelling with Cross-Modal Rules☆7Updated 5 years ago
- ☆25Updated 2 years ago
- ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration☆56Updated last year
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆48Updated 2 years ago
- Research code for CVPR 2022 paper: "EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching"☆25Updated 2 years ago
- sairin1202 / Commonsense-Knowledge-Aware-Concept-Selection-For-Diverse-and-Informative-Visual-StorytellingThe implement of Commonsense Knowledge Aware Concept Selection For Diverse and Informative Visual Storytelling☆11Updated 3 years ago
- Code for "On diversity in image captioning: metrics and methods".☆8Updated 4 years ago
- ☆42Updated 4 years ago
- A reading list of papers about Visual Question Answering.☆32Updated 2 years ago
- [CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)☆59Updated 3 years ago
- Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners☆114Updated 2 years ago
- Code for the paper "Controllable Video Captioning with an Exemplar Sentence"☆12Updated 3 years ago
- a py3 lib for NLP & image-caption metrics : BLEU METEOR CIDEr ROUGE SPICE WMD☆14Updated 2 years ago
- The SVO-Probes Dataset for Verb Understanding☆31Updated 3 years ago
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆120Updated last year
- Unpaired Image Captioning☆35Updated 4 years ago
- Some papers about *diverse* image (a few videos) captioning☆26Updated last year
- CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment☆22Updated 2 years ago
- [CVPR 2022] A large-scale public benchmark dataset for video question-answering, especially about evidence and commonsense reasoning. The…☆54Updated 8 months ago
- The code and output of our AAAI paper "Knowledge-Enriched Visual Storytelling"☆40Updated 3 years ago
- Github repository for Plot and Rework: Modeling Storylines for Visual Storytelling (ACL-IJCNLP2021 Findings)☆21Updated 2 years ago
- Codes for paper "Towards Diverse Paragraph Captioning for Untrimmed Videos". CVPR 2021☆66Updated 3 years ago
- Official code for the paper "Contrast and Classify: Training Robust VQA Models" published at ICCV, 2021☆19Updated 3 years ago
- Pytorch version of DeCEMBERT: Learning from Noisy Instructional Videos via Dense Captions and Entropy Minimization (NAACL 2021)☆17Updated 2 years ago
- Implementation for the paper "Unified Multimodal Model with Unlikelihood Training for Visual Dialog"☆13Updated last year
- Data of ACL 2019 Paper "Expressing Visual Relationships via Language".☆62Updated 4 years ago
- ☆28Updated 2 years ago
- ☆34Updated last year
- Video Graph Transformer for Video Question Answering (ECCV'22)☆47Updated last year
- Data Release for VALUE Benchmark☆31Updated 3 years ago