spotify-research / llark
Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, and Rachel Bittner.
☆312Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for llark
- Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".☆310Updated 7 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆284Updated 7 months ago
- MU-LLaMA: Music Understanding Large Language Model☆236Updated 7 months ago
- The latent diffusion model for text-to-music generation.☆155Updated 9 months ago
- AudioLDM training, finetuning, evaluation and inference.☆210Updated 5 months ago
- Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model☆147Updated 3 months ago
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆112Updated last year
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆142Updated 10 months ago
- Mustango: Toward Controllable Text-to-Music Generation☆342Updated 3 months ago
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆150Updated this week
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆156Updated 7 months ago
- Audio Dataset for training CLAP and other models☆637Updated 9 months ago
- This is a cog implementation of the fine-tuner for Meta's MusicGen☆48Updated 7 months ago
- ☆174Updated 9 months ago
- Teaching material for the course "Deep Learning for Music Analysis and Generation" I taught at National Taiwan University (2023 Fall)☆211Updated this week
- An Audio Language model for Audio Tasks☆290Updated 7 months ago
- music generation with masked transformers!☆303Updated last week
- Refactored / updated version of `stable-audio-tools` which is an open-source code for audio/music generative models originally by Stabili…☆144Updated 3 months ago
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆205Updated 3 months ago
- A swift and unified toolkit for symbolic music processing☆133Updated this week
- Learning audio concepts from natural language supervision☆487Updated 2 months ago
- A lightweight library for Frechet Audio Distance calculation.☆237Updated 2 months ago
- Anticipatory Autoregressive Models☆150Updated last month
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆304Updated last month
- The official GitHub page for the survey paper "Foundation Models for Music: A Survey".☆93Updated 2 months ago
- PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.☆192Updated last month
- Polyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controls☆74Updated 4 months ago
- ☆151Updated last year
- Encode and decode audio samples to/from compressed latent representations!☆149Updated 3 months ago
- ☆156Updated last year