AndreyGuzhov / AudioCLIPLinks
Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio" (https://arxiv.org/abs/2106.13043)
☆845Updated 4 years ago
Alternatives and similar repositories for AudioCLIP
Users that are interested in AudioCLIP are comparing it to the libraries listed below
Sorting:
- Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP☆355Updated 3 years ago
- This repo hosts the code and models of "Masked Autoencoders that Listen".☆616Updated last year
- Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)☆366Updated last year
- A concise but complete implementation of CLIP with various experimental improvements from recent papers☆716Updated last year
- Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".☆270Updated last year
- Contrastive Language-Audio Pretraining☆1,827Updated 4 months ago
- Learning audio concepts from natural language supervision☆599Updated last year
- Audio Dataset for training CLAP and other models☆711Updated last year
- VGGSound: A Large-scale Audio-Visual Dataset☆334Updated 4 years ago
- A curated list of different papers and datasets in various areas of audio-visual processing☆745Updated last year
- Pytorch port of Google Research's VGGish model used for extracting audio features.☆399Updated 3 years ago
- [CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation☆442Updated last year
- Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".☆1,347Updated 2 years ago
- A PyTorch Lightning solution to training OpenAI's CLIP from scratch.☆712Updated 3 years ago
- This toolbox aims to unify audio generation model evaluation for easier comparison.☆359Updated last year
- Efficient Training of Audio Transformers with Patchout☆351Updated last year
- Official PyTorch implementation of Contrastive Learning of Musical Representations☆334Updated last year
- A self-supervised learning framework for audio-visual speech☆939Updated last year
- Implementation of Parti, Google's pure attention-based text-to-image neural network, in Pytorch☆541Updated last year
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,265Updated 2 years ago
- [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer☆317Updated 3 months ago
- Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".☆399Updated 3 years ago
- A curated list of audio-visual learning methods and datasets.☆270Updated 10 months ago
- [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆302Updated 9 months ago
- The source code of our paper "Diffsound: discrete diffusion model for text-to-sound generation"☆362Updated 2 years ago
- Audio generation using diffusion models, in PyTorch.☆2,078Updated 2 years ago
- Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch☆551Updated 2 years ago
- ☆396Updated 8 months ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆987Updated last year
- The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"☆434Updated 2 weeks ago