spotify-research / llark
Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, and Rachel Bittner.
☆344Updated 11 months ago
Alternatives and similar repositories for llark
Users that are interested in llark are comparing it to the libraries listed below
Sorting:
- Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".☆372Updated last year
- MU-LLaMA: Music Understanding Large Language Model☆278Updated last year
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆322Updated last year
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆217Updated 3 weeks ago
- The latent diffusion model for text-to-music generation.☆169Updated last year
- AudioLDM training, finetuning, evaluation and inference.☆248Updated 5 months ago
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆476Updated 2 weeks ago
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆150Updated last year
- Mustango: Toward Controllable Text-to-Music Generation☆363Updated last month
- Encode and decode audio samples to/from compressed latent representations!☆207Updated 2 months ago
- Audio Dataset for training CLAP and other models☆681Updated last year
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆113Updated last year
- A lightweight library for Frechet Audio Distance calculation.☆269Updated 8 months ago
- Unified automatic quality assessment for speech, music, and sound.☆484Updated 2 weeks ago
- ☆200Updated last year
- Learning audio concepts from natural language supervision☆554Updated 7 months ago
- A simple library for Fréchet Audio Distance (FAD) calculation☆205Updated 2 weeks ago
- This is a cog implementation of the fine-tuner for Meta's MusicGen☆50Updated last year
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆337Updated 7 months ago
- ☆167Updated last year
- A swift and unified toolkit for symbolic music processing☆163Updated 2 weeks ago
- Anticipatory Autoregressive Models☆168Updated 2 weeks ago
- ☆166Updated 4 months ago
- Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model☆166Updated 9 months ago
- Download the MusicCaps dataset for music captioning☆112Updated 3 months ago
- Teaching material for the course "Deep Learning for Music Analysis and Generation" I taught at National Taiwan University (2023 Fall)☆218Updated 5 months ago
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆228Updated 9 months ago
- An Audio Language model for Audio Tasks☆304Updated last year
- Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".☆182Updated 4 months ago
- Object-oriented handling of audio data, with GPU-powered augmentations, and more.☆273Updated last month