shansongliu / MU-LLaMA
MU-LLaMA: Music Understanding Large Language Model
☆219Updated 5 months ago
Related projects: ⓘ
- AudioLDM training, finetuning, evaluation and inference.☆191Updated 3 months ago
- Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".☆294Updated 4 months ago
- The latent diffusion model for text-to-music generation.☆151Updated 7 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆266Updated 5 months ago
- Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, an…☆290Updated 3 months ago
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆141Updated 5 months ago
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆111Updated last year
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆194Updated last month
- A lightweight library for Frechet Audio Distance calculation.☆230Updated 2 weeks ago
- A simple library for Fréchet Audio Distance (FAD) calculation☆137Updated last week
- CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model☆177Updated 4 months ago
- ☆158Updated 7 months ago
- Unofficial download repository for MusicCaps☆41Updated last year
- PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.☆169Updated 3 weeks ago
- An Audio Language model for Audio Tasks☆281Updated 5 months ago
- Music Audio Representation Benchmark for Universal Evaluation☆84Updated 4 months ago
- Object-oriented handling of audio data, with GPU-powered augmentations, and more.☆218Updated last month
- Refactored / updated version of `stable-audio-tools` which is an open-source code for audio/music generative models originally by Stabili…☆111Updated last month
- VoiceLDM: Text-to-Speech with Environmental Context☆157Updated last month
- Teaching material for the course "Deep Learning for Music Analysis and Generation" I taught at National Taiwan University (2023 Fall)☆187Updated this week
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆140Updated last month
- Codes for ISMIR 2022 paper: Beat Transformer: Demixed Beat and Downbeat Tracking with Dilated Self-Attention☆88Updated 5 months ago
- [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer☆99Updated 5 months ago
- The official GitHub page for the survey paper "Foundation Models for Music: A Survey".☆79Updated 2 weeks ago
- unofficial implementation of the High Fidelity Neural Audio Compression☆129Updated last month
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆131Updated 8 months ago
- The Open Source Code of UniAudio☆509Updated last month
- Official Implementation of EnCLAP (ICASSP 2024)☆88Updated 3 months ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆415Updated 3 months ago
- Mustango: Toward Controllable Text-to-Music Generation☆323Updated last month