JaesungHuh / VoxMoviesLinks
Evaluation script for VoxMovies dataset in PyTorch
☆23Updated 2 years ago
Alternatives and similar repositories for VoxMovies
Users that are interested in VoxMovies are comparing it to the libraries listed below
Sorting:
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 4 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆57Updated 2 years ago
- Implementation of "Look, Listen and Recognise:character-aware audio-visual subtitling"☆19Updated 2 months ago
- Python code for handling the Clotho dataset.☆85Updated 5 years ago
- Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"☆27Updated 3 years ago
- Repo for Visual Acoustic Matching, CVPR 2022☆70Updated 2 years ago
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆118Updated 3 years ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆24Updated 3 years ago
- ☆67Updated 3 years ago
- ACAV100M: Automatic Curation of Large-Scale Datasets for Audio-Visual Video Representation Learning. In ICCV, 2021.☆63Updated 4 years ago
- Audio-visual diarization pipeline used for creating VoxConverse dataset☆21Updated 7 months ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆54Updated 2 years ago
- Splits for epic-sounds dataset☆84Updated 5 months ago
- Look Who’s Talking: Active Speaker Detection in the Wild☆76Updated 2 years ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆89Updated 3 years ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆54Updated 6 months ago
- [NeurIPS 2023 - ML for Audio Workshop (Oral)] Zero-shot audio captioning with audio-language model guidance and audio context keywords☆18Updated last year
- Solos: A Dataset for Audio-Visual Music Analysis☆24Updated 2 years ago
- (Hybrid) BYOL-S feature extractor using serab-byols package in pytorch.☆27Updated last year
- Pytorch implementation of "A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differences", Pranay Manocha et al. - un…☆64Updated 5 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆50Updated last year
- Facestar dataset. High quality audio-visual recordings of human conversational speech.☆110Updated 3 years ago
- Implementation of multi-level Contrastive Predictive Coding (CPC) methods☆20Updated 3 years ago
- (Interspeech 2023 & ICASSP 2024) Official repository for ARMHuBERT and STaRHuBERT☆40Updated last year
- ☆21Updated 3 years ago
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆15Updated 2 years ago
- Time-stretch audio clips quickly with PyTorch (CUDA supported)! Additional utilities for searching efficient transformations are included…☆40Updated 3 years ago
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 4 years ago
- ☆28Updated 4 years ago
- NU-Wave: A Diffusion Probabilistic Model for Neural Audio Upsampling☆37Updated 4 years ago