AndreyGuzhov / AudioCLIP
Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)
☆793Updated 3 years ago
Alternatives and similar repositories for AudioCLIP:
Users that are interested in AudioCLIP are comparing it to the libraries listed below
- Contrastive Language-Audio Pretraining☆1,531Updated 2 months ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆566Updated 10 months ago
- Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP☆336Updated 3 years ago
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆355Updated 7 months ago
- Audio Dataset for training CLAP and other models☆665Updated last year
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆244Updated 10 months ago
- Learning audio concepts from natural language supervision☆520Updated 4 months ago
- A concise but complete implementation of CLIP with various experimental improvements from recent papers☆707Updated last year
- The source code of our paper "Diffsound: discrete diffusion model for text-to-sound generation"☆354Updated last year
- [CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation☆414Updated 8 months ago
- VGGSound: A Large-scale Audio-Visual Dataset☆303Updated 3 years ago
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,229Updated 2 years ago
- An Audio Language model for Audio Tasks☆301Updated 9 months ago
- Library for Textless Spoken Language Processing☆532Updated last year
- Efficient Training of Audio Transformers with Patchout☆318Updated last year
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.☆677Updated 2 years ago
- BYOL for Audio: Self-Supervised Learning for General-Purpose Audio Representation☆209Updated last year
- 🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps☆151Updated 9 months ago
- Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch☆547Updated 2 years ago
- DiffWave is a fast, high-quality neural vocoder and waveform synthesizer.☆805Updated 10 months ago
- A curated list of different papers and datasets in various areas of audio-visual processing☆691Updated last year
- Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm☆644Updated 2 years ago
- Code release for SLIP Self-supervision meets Language-Image Pre-training☆755Updated 2 years ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆410Updated 9 months ago
- Pytorch port of Google Research's VGGish model used for extracting audio features.☆380Updated 3 years ago
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆320Updated 4 months ago
- Official implementation of VQ-Diffusion☆910Updated 9 months ago
- [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆274Updated last month
- Official PyTorch implementation of BigVGAN (ICLR 2023)☆949Updated 5 months ago
- Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".☆374Updated 2 years ago