descriptinc / lyrebird-wav2clip
Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP
☆323Updated 2 years ago
Related projects: ⓘ
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆338Updated 2 months ago
- AudioLDM training, finetuning, evaluation and inference.☆191Updated 3 months ago
- Official implementation of the pipeline presented in I hear your true colors: Image Guided Audio Generation☆102Updated last year
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆194Updated last month
- A novel diffusion-based model for synthesizing long-context, high-fidelity music efficiently.☆194Updated last year
- Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)☆746Updated 2 years ago
- The latent diffusion model for text-to-music generation.☆151Updated 7 months ago
- 🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps☆134Updated 4 months ago
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆111Updated last year
- Audio Dataset for training CLAP and other models☆615Updated 7 months ago
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆222Updated 6 months ago
- The source code of our paper "Diffsound: discrete diffusion model for text-to-sound generation"☆345Updated last year
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆148Updated 3 months ago
- A lightweight library for Frechet Audio Distance calculation.☆230Updated 2 weeks ago
- Trainer for audio-diffusion-pytorch☆127Updated last year
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆141Updated 5 months ago
- VGGSound: A Large-scale Audio-Visual Dataset☆285Updated 3 years ago
- Official implementation of VQMIVC: One-shot (any-to-any) Voice Conversion @ Interspeech 2021 + Online playing demo!☆334Updated 2 years ago
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆286Updated 3 months ago
- Official implementation of SawSing (ISMIR'22)☆250Updated 2 years ago
- BDDM: Bilateral Denoising Diffusion Models for Fast and High-Quality Speech Synthesis☆218Updated 2 years ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆204Updated last year
- [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer☆285Updated last month
- Perform transfer learning for MIR using Jukebox!☆171Updated 11 months ago
- [ICCV 2023] Video Background Music Generation: Dataset, Method and Evaluation☆65Updated 5 months ago
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆266Updated 5 months ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆522Updated 5 months ago
- An official reimplementation of the method described in the INTERSPEECH 2021 paper - Speech Resynthesis from Discrete Disentangled Self-S…☆375Updated last year
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆69Updated 9 months ago
- Learning audio concepts from natural language supervision☆458Updated 3 months ago