srvk / how2-dataset
This repository contains code and metadata of How2 dataset
☆172Updated last month
Alternatives and similar repositories for how2-dataset:
Users that are interested in how2-dataset are comparing it to the libraries listed below
- Code and dataset of "MEmoR: A Dataset for Multimodal Emotion Reasoning in Videos" in MM'20.☆53Updated last year
- Code for the paper Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems (ACL19)☆99Updated 2 years ago
- The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".☆55Updated 3 years ago
- This is the official code repository for the paper 'Cross-modality Data Augmentation for End-to-End Sign Language Translation'. Accepted…☆15Updated last year
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆50Updated 2 years ago
- ☆53Updated 5 years ago
- Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"☆139Updated 2 years ago
- EgoCom: A Multi-person Multi-modal Egocentric Communications Dataset☆56Updated 4 years ago
- ☆27Updated 4 years ago
- ☆53Updated 3 years ago
- Temporal Reasoning via Audio Question Answering☆23Updated 5 years ago
- A curated list of AWESOME papers, datasets and tutorials within Multimodal Machine Translation.☆36Updated 3 years ago
- Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''☆36Updated 3 years ago
- Multilingual speech translation☆41Updated 3 years ago
- ☆48Updated 6 years ago
- Zero -- A neural machine translation system☆150Updated last year
- [EMNLP 2020] What is More Likely to Happen Next? Video-and-Language Future Event Prediction☆48Updated 2 years ago
- Implementation of "Audio Retrieval with Natural Language Queries", INTERSPEECH 2021, PyTorch☆27Updated last year
- A collection of videos annotated with timelines where each video is divided into segments, and each segment is labelled with a short free…☆25Updated 3 years ago
- [EMNLP 2018] PyTorch code for TVQA: Localized, Compositional Video Question Answering☆172Updated 2 years ago
- A Large-Scale Open-Domain Sign Language Translation Dataset (ASL-English)☆61Updated 7 months ago
- Speech2vec pre-trained word vectors☆76Updated 6 years ago
- Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"☆27Updated 2 years ago
- Multi-modal Neural Machine Translation in PyTorch☆44Updated 6 years ago
- Code for ACL 2020 paper "Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA." Hyounghun Kim, Zineng T…☆34Updated 4 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆90Updated last year
- A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021☆47Updated 3 years ago
- SLTUNET: A Simple Unified Model for Sign Language Translation (ICLR 2023)☆28Updated last year
- Code and dataset release for "PACS: A Dataset for Physical Audiovisual CommonSense Reasoning" (ECCV 2022)☆12Updated 2 years ago
- Pre-training Cross-modal Transformer for Audio-and-Language Representations☆39Updated 3 years ago