hohsiangwu / rethinking-visual-sound-localizationLinks
Official implementation of the paper How to Listen? Rethinking Visual Sound Localization
☆17Updated 3 years ago
Alternatives and similar repositories for rethinking-visual-sound-localization
Users that are interested in rethinking-visual-sound-localization are comparing it to the libraries listed below
Sorting:
- Repo for Visual Acoustic Matching, CVPR 2022☆69Updated 2 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆49Updated last year
- Source code for the paper 'Audio Captioning Transformer'☆57Updated 3 years ago
- Official implementation of "Learning Music Audio Representations Via Weak Language Supervision" (ICASSP 2022)☆47Updated last year
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆89Updated 3 years ago
- COLA contrastive pre-training method implemented in PyTorch☆43Updated 4 years ago
- Python code for handling the Clotho dataset.☆85Updated 5 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆57Updated 2 years ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆24Updated 3 years ago
- Official PyTorch implementation of the TIP paper "Generating Visually Aligned Sound from Videos" and the corresponding Visually Aligned S…☆54Updated 5 years ago
- ☆43Updated 2 years ago
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆15Updated 2 years ago
- Source code for "Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors." (Spotlight at the BMVC 2022)☆53Updated last year
- Source code for training models and using the hyperbolic interface proposed in our ICASSP 2023 paper, “Hyperbolic Audio Source Separation…☆69Updated 2 years ago
- Code for paper Learning Audio-Visual Dereverberation☆30Updated 3 years ago
- A PyTorch implementation: "LASAFT-Net-v2: Listen, Attend and Separate by Attentively aggregating Frequency Transformation"☆33Updated 3 years ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆54Updated 5 months ago
- Unsupervised Representation Learning for Singing Voice Separation☆22Updated 2 years ago
- Splits for epic-sounds dataset☆84Updated 5 months ago
- Code for the paper "Unsupervised Contrastive Learning of Sound Event Representations", ICASSP 2021.☆93Updated 3 years ago
- [ICCV'21] The Right to Talk: An Audio-Visual Transformer Approach☆20Updated 4 years ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆38Updated 2 years ago
- A list of resources that can help in research for automated audio captioning☆34Updated 4 years ago
- The demo for "Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem".☆12Updated 4 years ago
- Baseline method for audio-visual sound event localization and detection task of DCASE 2023 challenge☆60Updated 9 months ago
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆26Updated last year
- The Easy Communications (EasyCom) dataset is a world-first dataset designed to help mitigate the *cocktail party effect* from an augmente…☆125Updated 2 years ago
- Solos: A Dataset for Audio-Visual Music Analysis☆24Updated 2 years ago
- (Hybrid) BYOL-S feature extractor using serab-byols package in pytorch.☆27Updated last year
- This repo contains code for comparing audio representation sin the task of audio synthesis wth Generative Adversarial Networks (GAN)☆38Updated 3 years ago