spotify-research / llarkLinks
Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, and Rachel Bittner.
☆353Updated last year
Alternatives and similar repositories for llark
Users that are interested in llark are comparing it to the libraries listed below
Sorting:
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆331Updated last year
- MU-LLaMA: Music Understanding Large Language Model☆277Updated last year
- Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".☆378Updated last month
- The latent diffusion model for text-to-music generation.☆173Updated last year
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆230Updated last week
- AudioLDM training, finetuning, evaluation and inference.☆253Updated 6 months ago
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆152Updated last year
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆347Updated 9 months ago
- A simple library for Fréchet Audio Distance (FAD) calculation☆222Updated last month
- Video2Music: Suitable Music Generation from Videos using an Affective Multimodal Transformer model☆175Updated 10 months ago
- Mustango: Toward Controllable Text-to-Music Generation☆368Updated 3 weeks ago
- Audio Dataset for training CLAP and other models☆688Updated last year
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆491Updated this week
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆113Updated last year
- Learning audio concepts from natural language supervision☆567Updated 9 months ago
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆184Updated last year
- Anticipatory Autoregressive Models☆174Updated last month
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆234Updated 11 months ago
- ☆259Updated last year
- A lightweight library for Frechet Audio Distance calculation.☆281Updated 9 months ago
- music generation with masked transformers!☆326Updated last month
- Fine-tune Stable Audio Open with DiT ControlNet.☆234Updated last month
- This is the PyTorch implementation of the Universal Source Separation with Weakly labelled Data.☆356Updated last year
- WavJourney: Compositional Audio Creation with LLMs☆536Updated last year
- Teaching material for the course "Deep Learning for Music Analysis and Generation" I taught at National Taiwan University (2023 Fall)☆219Updated 6 months ago
- This is a cog implementation of the fine-tuner for Meta's MusicGen☆53Updated last year
- An Audio Language model for Audio Tasks☆309Updated last year
- State-of-the-art pretrained music models for training, evaluation, inference☆113Updated last week
- ☆207Updated last year
- Unified automatic quality assessment for speech, music, and sound.☆515Updated 3 weeks ago