swimmiing / ACL-SSLLinks
Repository of the WACV'24 paper "Can CLIP Help Sound Source Localization?"
☆33Updated 9 months ago
Alternatives and similar repositories for ACL-SSL
Users that are interested in ACL-SSL are comparing it to the libraries listed below
Sorting:
- small audio language model for reasoning☆80Updated 7 months ago
- Inference codebase for "Cacophony: An Improved Contrastive Audio-Text Model". Preprint: https://arxiv.org/abs/2402.06986☆48Updated last year
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆64Updated 9 months ago
- [ICLR 2025] Enhancing Self-Supervised Models with Audio Mixtures for Polyphonic Soundscapes☆52Updated last month
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆93Updated last year
- ☆24Updated 2 months ago
- Official source code of the INTERSPEECH 2023 paper: "Audio-Visual Speech Separation in Noisy Environments with a Lightweight Iterative Mo…☆20Updated 2 years ago
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆31Updated 2 years ago
- [Official Implementation] Acoustic Autoregressive Modeling 🔥☆72Updated last year
- PyTorch implementation of the ICASSP-24 paper: "Improving Audio Captioning Models with Fine-grained Audio Features, Text Embedding Superv…☆38Updated last year
- ☆42Updated 2 years ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆58Updated last year
- Code for ICASSP 2024 Paper: RECAP: Retrieval-Augmented Audio Captioning☆15Updated last year
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Updated 9 months ago
- This is the official implementation of our multi-channel multi-speaker multi-spatial neural audio codec architecture.☆50Updated 8 months ago
- ☆41Updated 7 months ago
- [ICASSP2025] Official code for VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis☆24Updated 7 months ago
- Collection of works for evaluating (and analyzing) large audio-language models (LALMs)☆40Updated 3 months ago
- Code for paper Learning Audio-Visual Dereverberation☆30Updated 3 years ago
- Source code for the EMNLP 2025 paper “DM-Codec: Distilling Multimodal Representations for Speech Tokenization”☆55Updated 5 months ago
- Data Pipeline, Models, and Benchmark for Omni-Captioner.☆87Updated last month
- [InterSpeech'2024] FluentEditor:Text-based Speech Editing by Considering Acoustic and Prosody Consistency☆56Updated last year
- A toolkit for researchers in the multimodal sound separation.☆16Updated 2 years ago
- Baseline method for audio-visual sound event localization and detection task of DCASE 2023 challenge☆58Updated 8 months ago
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆38Updated last year
- Pytorch implementation for “V2C: Visual Voice Cloning”☆32Updated 2 years ago
- [SLT'24] The official implementation of SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model☆129Updated 2 weeks ago
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆72Updated 2 weeks ago
- DinoSR: Self-Distillation and Online Clustering for Self-supervised Speech Representation Learning☆49Updated last year
- The dataset and baseline code for Text-to-Audio Grounding (TAG)☆46Updated 3 weeks ago