descriptinc / lyrebird-wav2clip
Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP
☆328Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for lyrebird-wav2clip
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆348Updated 4 months ago
- Official implementation of the pipeline presented in I hear your true colors: Image Guided Audio Generation☆105Updated last year
- This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.☆205Updated 3 months ago
- AudioLDM training, finetuning, evaluation and inference.☆210Updated 5 months ago
- Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)☆772Updated 3 years ago
- Toward Universal Text-to-Music-Retrieval (TTMR) [ICASSP23]☆112Updated last year
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆157Updated 7 months ago
- Official PyTorch implementation of the TIP paper "Generating Visually Aligned Sound from Videos" and the corresponding Visually Aligned S…☆52Updated 3 years ago
- 🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps☆144Updated 7 months ago
- A novel diffusion-based model for synthesizing long-context, high-fidelity music efficiently.☆194Updated last year
- LP-MusicCaps: LLM-Based Pseudo Music Captioning [ISMIR23]☆285Updated 7 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆77Updated 5 months ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆206Updated last year
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆238Updated 8 months ago
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆161Updated 5 months ago
- The latent diffusion model for text-to-music generation.☆156Updated 9 months ago
- The source code of our paper "Diffsound: discrete diffusion model for text-to-sound generation"☆349Updated last year
- The repo host the code and model of MAViL.☆42Updated last year
- [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer☆292Updated 3 months ago
- Audio Dataset for training CLAP and other models☆638Updated 9 months ago
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆78Updated 11 months ago
- VGGSound: A Large-scale Audio-Visual Dataset☆292Updated 3 years ago
- Long-Term Rhythmic Video Soundtracker, ICML2023☆54Updated 4 months ago
- Official PyTorch implementation of Contrastive Learning of Musical Representations☆309Updated 3 months ago
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆305Updated last month
- official code for CVPR'24 paper Diff-BGM☆47Updated last month
- An official reimplementation of the method described in the INTERSPEECH 2021 paper - Speech Resynthesis from Discrete Disentangled Self-S…☆391Updated last year
- SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model, Accepted to IEEE SLT 2022☆110Updated last year
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆547Updated 7 months ago
- This package aims at simplifying the download of the AudioCaps dataset.☆30Updated 11 months ago