Alternatives and similar repositories for how2-dataset:

Users that are interested in how2-dataset are comparing it to the libraries listed below

• henryhungle / MTN
  Code for the paper Multimodal Transformer Networks for End-to-End Video-Grounded Dialogue Systems (ACL19)
  ☆99Updated 2 years ago
• bzhangGo / zero
  Zero -- A neural machine translation system
  ☆150Updated last year
• iamyuanchung / speech2vec-pretrained-vectors
  Speech2vec pre-trained word vectors
  ☆76Updated 6 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆139Updated 2 years ago
• roudimit / AVLnet
  Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.
  ☆50Updated 3 years ago
• HLTCHKUST / VG-GPLMs
  The code repository for EMNLP 2021 paper "Vision Guided Generative Pre-trained Language Models for Multimodal Abstractive Summarization".
  ☆55Updated 3 years ago
• iriscxy / VMSMO
  Official code and dataset link for ''VMSMO: Learning to Generate Multimodal Summary for Video-based News Articles''
  ☆36Updated 3 years ago
• sunlightsgy / MEmoR
  Code and dataset of "MEmoR: A Dataset for Multimodal Emotion Reasoning in Videos" in MM'20.
  ☆53Updated last year
• hudaAlamri / DSTC7-Audio-Visual-Scene-Aware-Dialog-AVSD-Challenge
  ☆53Updated 5 years ago
• berniebear / Multi-HT100M
  ☆53Updated 3 years ago
• iacercalixto / MultimodalNMT
  Multi-modal Neural Machine Translation in PyTorch
  ☆44Updated 6 years ago
• facebookresearch / daqa
  Temporal Reasoning via Audio Question Answering
  ☆24Updated 5 years ago
• dialogtekgeek / AVSD-DSTC10_Official
  Audio Visual Scene-Aware Dialog (AVSD) Challenge at the 10th Dialog System Technology Challenge (DSTC)
  ☆27Updated 2 years ago
• linjieli222 / HERO
  Research code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"
  ☆231Updated 3 years ago
• facebookresearch / EgoCom-Dataset
  EgoCom: A Multi-person Multi-modal Egocentric Communications Dataset
  ☆56Updated 4 years ago
• oncescuandreea / audio-retrieval
  Implementation of "Audio Retrieval with Natural Language Queries", INTERSPEECH 2021, PyTorch
  ☆27Updated last year
• WasifurRahman / BERT_multimodal_transformer
  ☆201Updated 3 years ago
• QAQ-v / MMT
  ☆15Updated 4 years ago
• audioku / meta-transfer-learning
  Implementation of meta-transfer-learning for ASR and LM (ACL 2020)
  ☆50Updated 4 years ago
• jayleicn / TVQA
  [EMNLP 2018] PyTorch code for TVQA: Localized, Compositional Video Question Answering
  ☆173Updated 2 years ago
• iacercalixto / variational_mmt
  Code base for the paper "Latent variable model for multi-modal translation".
  ☆16Updated 8 months ago
• hainow / MCTN
  ☆48Updated 6 years ago
• dharwath / DAVEnet-pytorch
  Deep Audio-Visual Embedding network (DAVEnet) implementation in PyTorch
  ☆65Updated 6 years ago
• Glaciohound / Chimera-ST
  A PyTorch implementation of paper "Learning Shared Semantic Space for Speech-to-Text Translation", ACL (Findings) 2021
  ☆47Updated 3 years ago
• jayleicn / TVCaption
  [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset
  ☆90Updated last year
• ZihengZZH / awesome-multimodal-machine-translation
  A curated list of AWESOME papers, datasets and tutorials within Multimodal Machine Translation.
  ☆36Updated 3 years ago
• formiel / speech-translation
  Multilingual speech translation
  ☆41Updated 3 years ago
• wnhsu / ResDAVEnet-VQ
  Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"
  ☆27Updated 3 years ago
• Atrewin / SignXmDA
  This is the official code repository for the paper 'Cross-modality Data Augmentation for End-to-End Sign Language Translation'. Accepted…
  ☆15Updated last year
• cgpotts / swda
  Switchboard Dialog Act Corpus with Penn Treebank links
  ☆144Updated 4 years ago