hohsiangwu / rethinking-visual-sound-localization
Official implementation of the paper How to Listen? Rethinking Visual Sound Localization
☆16Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for rethinking-visual-sound-localization
- ☆13Updated 2 years ago
- The Pytorch implementation of paper: Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training☆39Updated last year
- Official implementation of "Learning Music Audio Representations Via Weak Language Supervision" (ICASSP 2022)☆46Updated 2 years ago
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆31Updated 10 months ago
- ☆35Updated last year
- music semantic understanding evaluation benchmark☆25Updated last year
- An implementation of "Towards Improving Harmonic Sensitivity and Prediction Stability for Singing Melody Extraction", in ISMIR 2023☆19Updated 10 months ago
- Repo for Visual Acoustic Matching, CVPR 2022☆65Updated last year
- This repo contains the code to reproduce the paper: "Enriched Music Representations with Multiple Cross-modal Contrastive Learning"☆14Updated last year
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆28Updated last year
- ☆9Updated 5 months ago
- Source code for the paper 'Audio Captioning Transformer'☆50Updated 2 years ago
- A PyTorch implementation: "LASAFT-Net-v2: Listen, Attend and Separate by Attentively aggregating Frequency Transformation"☆33Updated 2 years ago
- Project website for "Telling left from right: Learning spatial correspondence between sight and sound"☆20Updated 2 years ago
- experiments about AudioSet☆43Updated last year
- Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)☆16Updated last year
- Simple baseline model for the HEAR benchmark☆23Updated 3 weeks ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆83Updated 2 years ago
- Audio Generation model working with GPT-2 and VQVAE compressed representation of MelSpectrograms☆18Updated last year
- PodcastMix A dataset for separating music and speech in podcasts.☆43Updated 3 months ago
- ☆32Updated 3 years ago
- Implementation of "Audio Retrieval with Natural Language Queries: A Benchmark Study".☆47Updated 2 years ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- A list of resources that can help in research for automated audio captioning☆34Updated 3 years ago
- Solos: A Dataset for Audio-Visual Music Analysis☆21Updated last year
- Code for paper Learning Audio-Visual Dereverberation☆26Updated 2 years ago
- Frechet Audio Distance evaluation in PyTorch☆35Updated last year
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆19Updated last year
- SAMO: SPEAKER ATTRACTOR MULTI-CENTER ONE-CLASS LEARNING FOR VOICE ANTI-SPOOFING☆36Updated last year
- Code for ICLR 2024 Paper: CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models☆13Updated 4 months ago