spotify-research / llarkLinks
Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, and Rachel Bittner.
☆371Updated last year
Alternatives and similar repositories for llark
Users that are interested in llark are comparing it to the libraries listed below
Sorting:
- Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".☆421Updated 7 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆343Updated last year
- MU-LLaMA: Music Understanding Large Language Model☆298Updated 4 months ago
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆164Updated 2 years ago
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆273Updated 3 weeks ago
- The latent diffusion model for text-to-music generation.☆182Updated last year
- Mustango: Toward Controllable Text-to-Music Generation☆386Updated 7 months ago
- Audio Dataset for training CLAP and other models☆725Updated last year
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆114Updated 2 years ago
- Anticipatory Autoregressive Models☆181Updated 2 months ago
- AudioLDM training, finetuning, evaluation and inference.☆286Updated last year
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆370Updated last year
- ☆243Updated last year
- music generation with masked transformers!☆347Updated 7 months ago
- Encode and decode audio samples to/from compressed latent representations!☆241Updated 3 months ago
- A swift and unified toolkit for symbolic music processing☆175Updated 2 weeks ago
- This is a cog implementation of the fine-tuner for Meta's MusicGen☆54Updated last year
- Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model☆189Updated last year
- Download the MusicCaps dataset for music captioning☆112Updated 10 months ago
- List of academic resources on Multimodal ML for Music☆297Updated 2 years ago
- This is the PyTorch implementation of the Universal Source Separation with Weakly labelled Data.☆368Updated 2 years ago
- Teaching material for the course "Deep Learning for Music Analysis and Generation" I taught at National Taiwan University☆231Updated last month
- ☆171Updated 2 years ago
- ☆178Updated 2 years ago
- Learning audio concepts from natural language supervision☆623Updated last year
- Refactored / updated version of `stable-audio-tools` which is an open-source code for audio/music generative models originally by Stabili…☆214Updated last year
- Fine-tune your own MusicGen with LoRA☆154Updated last year
- ☆294Updated last year
- Unified automatic quality assessment for speech, music, and sound.☆653Updated 6 months ago
- CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages [ACL 2025]☆212Updated 7 months ago