yizhilll / MERT
Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".
☆361Updated 11 months ago
Alternatives and similar repositories for MERT:
Users that are interested in MERT are comparing it to the libraries listed below
- MU-LLaMA: Music Understanding Large Language Model☆274Updated last year
- A lightweight library for Frechet Audio Distance calculation.☆267Updated 7 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆315Updated last year
- Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, an…☆341Updated 10 months ago
- Audio Dataset for training CLAP and other models☆673Updated last year
- A simple library for Fréchet Audio Distance (FAD) calculation☆197Updated last month
- ☆197Updated last year
- The Song Describer dataset is an evaluation dataset made of ~1.1k captions for 706 permissively licensed music recordings.☆151Updated last year
- The latent diffusion model for text-to-music generation.☆165Updated last year
- Teaching material for the course "Deep Learning for Music Analysis and Generation" I taught at National Taiwan University (2023 Fall)☆217Updated 4 months ago
- Learning audio concepts from natural language supervision☆545Updated 6 months ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆425Updated 11 months ago
- Official PyTorch implementation of Contrastive Learning of Musical Representations☆318Updated 8 months ago
- AudioLDM training, finetuning, evaluation and inference.☆244Updated 4 months ago
- Music Audio Representation Benchmark for Universal Evaluation☆102Updated 11 months ago
- Keep track of big models in audio domain, including speech, singing, music etc.☆476Updated 6 months ago
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆220Updated 8 months ago
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆113Updated last year
- Self-supervised learning for fast pitch estimation☆216Updated last month
- The Open Source Code of UniAudio☆554Updated 8 months ago
- An Audio Language model for Audio Tasks☆304Updated 11 months ago
- Codes for ISMIR 2022 paper: Beat Transformer: Demixed Beat and Downbeat Tracking with Dilated Self-Attention☆105Updated last year
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆333Updated 6 months ago
- Official repository of the paper "MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantization".☆173Updated 3 months ago
- Official Implementation of "Multitrack Music Transformer" (ICASSP 2023)☆144Updated last year
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆452Updated 3 weeks ago
- Metrics for evaluating music and audio generative models – with a focus on long-form, full-band, and stereo generations.☆206Updated 3 weeks ago
- ☆413Updated last year
- Unified automatic quality assessment for speech, music, and sound.☆455Updated last week
- Encode and decode audio samples to/from compressed latent representations!☆190Updated last month