JaesungHuh / VoxMoviesLinks
Evaluation script for VoxMovies dataset in PyTorch
☆23Updated last year
Alternatives and similar repositories for VoxMovies
Users that are interested in VoxMovies are comparing it to the libraries listed below
Sorting:
- Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"☆27Updated 3 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 4 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆57Updated 2 years ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆116Updated 3 years ago
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.☆62Updated 4 years ago
- Python code for handling the Clotho dataset.☆85Updated 5 years ago
- Splits for epic-sounds dataset☆83Updated 4 months ago
- Repo for Visual Acoustic Matching, CVPR 2022☆70Updated 2 years ago
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆21Updated 6 months ago
- Implementation of multi-level Contrastive Predictive Coding (CPC) methods☆19Updated 2 years ago
- ☆66Updated 3 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆53Updated last year
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆24Updated 3 years ago
- Solos: A Dataset for Audio-Visual Music Analysis☆24Updated 2 years ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆54Updated 4 months ago
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 3 years ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆89Updated 3 years ago
- Facestar dataset. High quality audio-visual recordings of human conversational speech.☆110Updated 3 years ago
- Look Who’s Talking: Active Speaker Detection in the Wild☆75Updated 2 years ago
- WaveNet auto-ancoders for ZeroSpeech challenge 2020☆37Updated 3 years ago
- ☆12Updated 5 years ago
- Vector Quantized Autoregressive Predictive Coding (VQ-APC)☆37Updated 5 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆46Updated 11 months ago
- ☆20Updated 3 years ago
- Transformer-based visually grounded speech models☆19Updated 3 years ago
- ☆20Updated 3 years ago
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated 2 years ago
- Implementation of "Audio Retrieval with Natural Language Queries", INTERSPEECH 2021, PyTorch☆26Updated 2 years ago
- COLA contrastive pre-training method implemented in PyTorch☆43Updated 4 years ago
- Semi-supervised Learning for Multi-speaker Text-to-speech Synthesis Using Discrete Speech Representation☆39Updated 5 years ago