kaistmm / Audio-Mamba-AuM
Official Implementation of the work "Audio Mamba: Bidirectional State Space Model for Audio Representation Learning"
☆100Updated last week
Related projects ⓘ
Alternatives and complementary repositories for Audio-Mamba-AuM
- [SLT'24] The official implementation of SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model☆104Updated last month
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆36Updated 3 months ago
- ☆129Updated 3 weeks ago
- Learning differentiable temporal resolution on time-series data.☆32Updated 2 years ago
- [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer☆114Updated 7 months ago
- A library built for easier audio self-supervised training, downstream tasks evaluation☆106Updated 2 months ago
- 🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)☆32Updated last month
- Official Implementation of EnCLAP (ICASSP 2024)☆90Updated 5 months ago
- ☆55Updated last month
- VoiceLDM: Text-to-Speech with Environmental Context☆163Updated 3 months ago
- Official implementation of RAVEn (ICLR 2023) and BRAVEn (ICASSP 2024)☆55Updated 4 months ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆47Updated 7 months ago
- This repo includes the official implementations of "Fine-tune the pretrained ATST model for sound event detection".☆100Updated last month
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆44Updated 2 months ago
- ☆35Updated last year
- The official implementation of our paper "Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tu…☆71Updated 2 months ago
- Codebase for the paper 'EncodecMAE: Leveraging neural codecs for universal audio representation learning'☆88Updated 3 months ago
- Audio Captioning datasets for PyTorch.☆107Updated 2 weeks ago
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆104Updated last month
- Official implementation for our paper "Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations"☆31Updated 5 months ago
- SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer.☆64Updated last week
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆64Updated 2 weeks ago
- [Interspeech 2024] Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation☆80Updated this week
- Source code for the paper 'Audio Captioning Transformer'☆50Updated 2 years ago
- Masked Modeling Duo: Towards a Universal Audio Pre-training Framework☆76Updated 3 months ago
- Public Code for the paper MAE-AST: Masked Autoencoding Audio Spectrogram Transformer☆83Updated 2 years ago
- The official implementation of V-AURA: Temporally Aligned Audio for Video with Autoregression☆13Updated last month
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆51Updated last month
- [Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units☆25Updated 3 weeks ago
- [ACL 2024] This is the Pytorch code for our paper "StyleDubber: Towards Multi-Scale Style Learning for Movie Dubbing"☆50Updated last week