JaesungHuh / VoxMoviesLinks
Evaluation script for VoxMovies dataset in PyTorch
☆23Updated last year
Alternatives and similar repositories for VoxMovies
Users that are interested in VoxMovies are comparing it to the libraries listed below
Sorting:
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 4 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆55Updated 2 years ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆116Updated 2 years ago
- Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"☆27Updated 3 years ago
- Python code for handling the Clotho dataset.☆84Updated 4 years ago
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.☆62Updated 3 years ago
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆21Updated 4 months ago
- Look Who’s Talking: Active Speaker Detection in the Wild☆74Updated 2 years ago
- Implementation of multi-level Contrastive Predictive Coding (CPC) methods☆19Updated 2 years ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆24Updated 3 years ago
- Repo for Visual Acoustic Matching, CVPR 2022☆68Updated 2 years ago
- ☆66Updated 3 years ago
- Facestar dataset. High quality audio-visual recordings of human conversational speech.☆110Updated 3 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆53Updated last year
- Splits for epic-sounds dataset☆83Updated 2 months ago
- ☆37Updated 4 years ago
- ☆12Updated 5 years ago
- Unofficial PyTorch implementation of Masked Autoencoders that Listen☆70Updated 3 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆42Updated 10 months ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆88Updated 3 years ago
- WaveNet auto-ancoders for ZeroSpeech challenge 2020☆37Updated 3 years ago
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 3 years ago
- NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling☆37Updated 4 years ago
- (Hybrid) BYOL-S feature extractor using serab-byols package in pytorch.☆27Updated last year
- Pytorch Implementation of WaveNODE☆64Updated 5 years ago
- Vector Quantized Autoregressive Predictive Coding (VQ-APC)☆37Updated 4 years ago
- Transformer-based visually grounded speech models☆19Updated 3 years ago
- BERT and LSTM baseline models of the ZeroSpeech Challenge 2021☆60Updated 3 years ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆40Updated last year
- [NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords☆18Updated 11 months ago