karreny / telling-left-from-right
Project website for "Telling left from right: Learning spatial correspondence between sight and sound"
☆20Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for telling-left-from-right
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆83Updated 2 years ago
- ☆35Updated last year
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆39Updated last year
- Code for paper Learning Audio-Visual Dereverberation☆26Updated 2 years ago
- Official implementation of "Learning Music Audio Representations Via Weak Language Supervision" (ICASSP 2022)☆46Updated 2 years ago
- Repo for Visual Acoustic Matching, CVPR 2022☆65Updated last year
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆16Updated last year
- Evaluation script for VoxMovies dataset in PyTorch☆22Updated 10 months ago
- Code and datasets for 'Few-Shot Audio-Visual Learning of Environment Acoustics' (NeurIPS 2022)☆14Updated last year
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆51Updated 9 months ago
- Solos: A Dataset for Audio-Visual Music Analysis☆21Updated last year
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- a pytorch implementation of Google GEDLoss☆32Updated 3 years ago
- SRTNet☆24Updated last year
- Official PyTorch implementation of the TIP paper "Generating Visually Aligned Sound from Videos" and the corresponding Visually Aligned S…☆52Updated 3 years ago
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆14Updated last year
- Pytorch implementation of "A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differences", Pranay Manocha et al. - un…☆61Updated 4 years ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆31Updated 10 months ago
- experiments about AudioSet☆43Updated last year
- COLA contrastive pre-training method implemented in PyTorch☆42Updated 3 years ago
- Implementation of multi-level Contrastive Predictive Coding (CPC) methods☆20Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆50Updated 2 years ago
- Official implementation of the paper How to Listen? Rethinking Visual Sound Localization☆16Updated 2 years ago
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆28Updated last year
- ☆79Updated last year
- Pytorch implementation for “V2C: Visual Voice Cloning”☆30Updated last year
- Source code for training models and using the hyperbolic interface proposed in our ICASSP 2023 paper, “Hyperbolic Audio Source Separation…☆57Updated last year
- Official codes for the paper "Learning Hierarchical Discrete Linguistic Units from Visually-Grounded Speech"☆26Updated 2 years ago
- Audio Generation model working with GPT-2 and VQVAE compressed representation of MelSpectrograms☆18Updated last year
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆19Updated last year