microsoft / CLAP
Learning audio concepts from natural language supervision
☆532Updated 5 months ago
Alternatives and similar repositories for CLAP:
Users that are interested in CLAP are comparing it to the libraries listed below
- Audio Dataset for training CLAP and other models☆669Updated last year
- Contrastive Language-Audio Pretraining☆1,557Updated 3 months ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆416Updated 10 months ago
- Official implementation of the paper "Acoustic Music Understanding Model with Large-Scale Self-supervised Training".☆358Updated 10 months ago
- An Audio Language model for Audio Tasks☆301Updated 10 months ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆571Updated 11 months ago
- Keep track of big models in audio domain, including speech, singing, music etc.☆471Updated 5 months ago
- Official PyTorch implementation of BigVGAN (ICLR 2023)☆966Updated 6 months ago
- This repository aims at providing efficient CNNs for Audio Tagging. We provide AudioSet pre-trained models ready for downstream training …☆269Updated 3 months ago
- Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.☆654Updated 7 months ago
- The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"☆389Updated 6 months ago
- AudioLDM training, finetuning, evaluation and inference.☆238Updated 2 months ago
- The Open Source Code of UniAudio☆546Updated 7 months ago
- Efficient Training of Audio Transformers with Patchout☆323Updated last year
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆217Updated 7 months ago
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆323Updated 5 months ago
- An Open-source Streaming High-fidelity Neural Audio Codec☆458Updated last week
- Official PyTorch implementation of Contrastive Learning of Musical Representations☆316Updated 7 months ago
- MU-LLaMA: Music Understanding Large Language Model☆269Updated 11 months ago
- This repository is an implementation of this article: https://arxiv.org/pdf/2107.03312.pdf☆380Updated 2 years ago
- Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, an…☆338Updated 9 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆308Updated 11 months ago
- Collection of audio-focused loss functions in PyTorch☆766Updated 7 months ago
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆266Updated this week
- Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".☆374Updated 2 years ago
- A lightweight library for Frechet Audio Distance calculation.☆255Updated 6 months ago
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆358Updated 8 months ago
- A simple library for Fréchet Audio Distance (FAD) calculation☆184Updated this week
- The official code repo for "Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data", in AAAI 2022☆195Updated 2 years ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆530Updated 9 months ago