Alternatives and similar repositories for AudioCLIP

Users that are interested in AudioCLIP are comparing it to the libraries listed below

• descriptinc / lyrebird-wav2clip
  Official implementation of the paper WAV2CLIP: LEARNING ROBUST AUDIO REPRESENTATIONS FROM CLIP
  ☆355Updated 3 years ago
• LAION-AI / CLAP
  Contrastive Language-Audio Pretraining
  ☆1,919Updated 6 months ago
• facebookresearch / AudioMAE
  This repo hosts the code and models of "Masked Autoencoders that Listen".
  ☆631Updated last year
• v-iashin / SpecVQGAN
  Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)
  ☆369Updated last year
• microsoft / CLAP
  Learning audio concepts from natural language supervision
  ☆618Updated last year
• LAION-AI / audio-dataset
  Audio Dataset for training CLAP and other models
  ☆721Updated last year
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆279Updated last year
• lucidrains / x-clip
  A concise but complete implementation of CLIP with various experimental improvements from recent papers
  ☆719Updated 2 years ago
• YuanGongND / ast
  Code for the Interspeech 2021 paper "AST: Audio Spectrogram Transformer".
  ☆1,386Updated 2 years ago
• hche11 / VGGSound
  VGGSound: A Large-scale Audio-Visual Dataset
  ☆346Updated 4 years ago
• krantiparida / awesome-audio-visual
  A curated list of different papers and datasets in various areas of audio-visual processing
  ☆751Updated last year
• harritaylor / torchvggish
  Pytorch port of Google Research's VGGish model used for extracting audio features.
  ☆405Updated 4 years ago
• researchmm / MM-Diffusion
  [CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
  ☆449Updated last year
• haoheliu / audioldm_eval
  This toolbox aims to unify audio generation model evaluation for easier comparison.
  ☆365Updated last year
• facebookresearch / av_hubert
  A self-supervised learning framework for audio-visual speech
  ☆955Updated 2 years ago
• YuanGongND / ssast
  Code for the AAAI 2022 paper "SSAST: Self-Supervised Audio Spectrogram Transformer".
  ☆406Updated 3 years ago
• wzk1015 / video-bgm-generation
  [ACM MM 2021 Best Paper Award] Video Background Music Generation with Controllable Music Transformer
  ☆321Updated 6 months ago
• TXH-mercury / VALOR
  [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
  ☆305Updated 11 months ago
• XinhaoMei / WavCaps
  This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
  ☆251Updated last year
• microsoft / Pengi
  An Audio Language model for Audio Tasks
  ☆317Updated last year
• kkoutini / PaSST
  Efficient Training of Audio Transformers with Patchout
  ☆360Updated last year
• lucidrains / nuwa-pytorch
  Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch
  ☆550Updated 2 years ago
• GeWu-Lab / awesome-audiovisual-learning
  A curated list of audio-visual learning methods and datasets.
  ☆277Updated last year
• RetroCirce / HTS-Audio-Transformer
  The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"
  ☆448Updated 2 months ago
• YuanGongND / ltu
  Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".
  ☆461Updated last year
• Zasder3 / train-CLIP
  A PyTorch Lightning solution to training OpenAI's CLIP from scratch.
  ☆717Updated 3 years ago
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆199Updated 2 months ago
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,270Updated 3 years ago
• ArrowLuo / CLIP4Clip
  An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
  ☆1,009Updated last year
• qiuqiangkong / audioset_tagging_cnn
  ☆1,629Updated last year