spotify-research / llarkLinks
Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, and Rachel Bittner.
☆344Updated last year
Alternatives and similar repositories for llark
Users that are interested in llark are comparing it to the libraries listed below
Sorting:
- Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".☆377Updated 2 weeks ago
- MU-LLaMA: Music Understanding Large Language Model☆276Updated last year
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆328Updated last year
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆151Updated last year
- The latent diffusion model for text-to-music generation.☆170Updated last year
- AudioLDM training, finetuning, evaluation and inference.☆250Updated 5 months ago
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆223Updated last month
- Teaching material for the course "Deep Learning for Music Analysis and Generation" I taught at National Taiwan University (2023 Fall)☆218Updated 6 months ago
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆486Updated last month
- Audio Dataset for training CLAP and other models☆685Updated last year
- Mustango: Toward Controllable Text-to-Music Generation☆363Updated this week
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆113Updated last year
- Encode and decode audio samples to/from compressed latent representations!☆211Updated 3 months ago
- This is a cog implementation of the fine-tuner for Meta's MusicGen☆53Updated last year
- The official GitHub page for the survey paper "Foundation Models for Music: A Survey".☆206Updated 9 months ago
- ☆202Updated last year
- Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model☆171Updated 10 months ago
- Anticipatory Autoregressive Models☆169Updated last month
- A simple library for Fréchet Audio Distance (FAD) calculation☆214Updated last week
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆183Updated last year
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆231Updated 10 months ago
- Download the MusicCaps dataset for music captioning☆110Updated 3 months ago
- A lightweight library for Frechet Audio Distance calculation.☆275Updated 9 months ago
- Refactored / updated version of `stable-audio-tools` which is an open-source code for audio/music generative models originally by Stabili…☆190Updated 10 months ago
- Official Implementation of "Multitrack Music Transformer" (ICASSP 2023)☆146Updated last year
- Music Audio Representation Benchmark for Universal Evaluation☆107Updated 3 weeks ago
- music generation with masked transformers!☆326Updated 3 weeks ago
- Object-oriented handling of audio data, with GPU-powered augmentations, and more.☆275Updated 2 months ago
- CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages [ACL 2025]☆159Updated 3 weeks ago
- Source code for "FIGARO: Generating Symbolic Music with Fine-Grained Artistic Control"☆156Updated 7 months ago