JaesungHuh / VoxMoviesLinks
Evaluation script for VoxMovies dataset in PyTorch
☆23Updated last year
Alternatives and similar repositories for VoxMovies
Users that are interested in VoxMovies are comparing it to the libraries listed below
Sorting:
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆57Updated 2 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 4 years ago
- Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"☆27Updated 3 years ago
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆21Updated 5 months ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆24Updated 3 years ago
- Repo for Visual Acoustic Matching, CVPR 2022☆70Updated 2 years ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆116Updated 2 years ago
- Look Who’s Talking: Active Speaker Detection in the Wild☆75Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆53Updated last year
- Implementation of multi-level Contrastive Predictive Coding (CPC) methods☆19Updated 2 years ago
- Facestar dataset. High quality audio-visual recordings of human conversational speech.☆110Updated 3 years ago
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.☆62Updated 4 years ago
- Python code for handling the Clotho dataset.☆85Updated 4 years ago
- [NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords☆18Updated 11 months ago
- ☆66Updated 3 years ago
- (Hybrid) BYOL-S feature extractor using serab-byols package in pytorch.☆27Updated last year
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆43Updated 11 months ago
- ☆12Updated 5 years ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆88Updated 3 years ago
- ☆27Updated 3 years ago
- Unofficial PyTorch implementation of Masked Autoencoders that Listen☆70Updated 3 years ago
- ☆20Updated last year
- Splits for epic-sounds dataset☆83Updated 3 months ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆52Updated 4 months ago
- NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling☆37Updated 4 years ago
- Word Discovery in Visually Grounded, Self-Supervised Speech Models☆26Updated last year
- Syllable Segmentation and Cross-Lingual Generalization in a Visually Grounded, Self-Supervised Speech Model☆34Updated 2 years ago
- Time-stretch audio clips quickly with PyTorch (CUDA supported)! Additional utilities for searching efficient transformations are included…☆40Updated 3 years ago
- Codebase for the paper "Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation" (ECCV2020)☆72Updated 5 years ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆39Updated last year