hohsiangwu / rethinking-visual-sound-localization
Official implementation of the paper How to Listen? Rethinking Visual Sound Localization
☆17Updated 2 years ago
Alternatives and similar repositories for rethinking-visual-sound-localization:
Users that are interested in rethinking-visual-sound-localization are comparing it to the libraries listed below
- Official implementation of "Learning Music Audio Representations Via Weak Language Supervision" (ICASSP 2022)☆46Updated 4 months ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆42Updated 4 months ago
- Source code for the paper 'Audio Captioning Transformer'☆54Updated 3 years ago
- ☆40Updated 2 years ago
- Code for ICLR 2024 Paper: CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models☆16Updated 9 months ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆36Updated last year
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆15Updated last year
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆19Updated last year
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆31Updated last year
- ☆13Updated 2 years ago
- Audio Generation model working with GPT-2 and VQVAE compressed representation of MelSpectrograms☆18Updated last year
- Solos: A Dataset for Audio-Visual Music Analysis☆21Updated 2 years ago
- Repo for Visual Acoustic Matching, CVPR 2022☆67Updated 2 years ago
- COLA contrastive pre-training method implemented in PyTorch☆43Updated 4 years ago
- The demo for "Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem".☆12Updated 3 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated 2 years ago
- Unsupervised Representation Learning for Singing Voice Separation☆22Updated 2 years ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆88Updated 2 years ago
- [TOMM 2024] Automatic Lyric Transcription and Automatic Music Transcription from Multimodal Singing☆21Updated 7 months ago
- Python code for handling the Clotho dataset.☆82Updated 4 years ago
- Who calls the shots? Rethinking Few-Shot Learning for Audio (WASPAA 2021)☆42Updated 2 years ago
- Simple baseline model for the HEAR benchmark☆23Updated last month
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆23Updated 2 years ago
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆46Updated 2 months ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆51Updated 2 years ago
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆46Updated 6 months ago
- Source code for training models and using the hyperbolic interface proposed in our ICASSP 2023 paper, “Hyperbolic Audio Source Separation…☆64Updated last year
- experiments about AudioSet☆44Updated last year
- Code for paper Learning Audio-Visual Dereverberation☆27Updated 2 years ago
- A PyTorch implementation: "LASAFT-Net-v2: Listen, Attend and Separate by Attentively aggregating Frequency Transformation"☆33Updated 3 years ago