Alternatives and similar repositories for WavCaps

Users that are interested in WavCaps are comparing it to the libraries listed below

• microsoft / Pengi
  An Audio Language model for Audio Tasks
  ☆316Updated last year
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆191Updated 2 weeks ago
• Labbeti / aac-datasets
  Audio Captioning datasets for PyTorch.
  ☆122Updated 3 months ago
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆189Updated 3 months ago
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆36Updated last year
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆186Updated 10 months ago
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆122Updated 10 months ago
• thuhcsi / SECap
  ☆172Updated last year
• speedyseal / audiosetdl
  Scripts for download AudioSet
  ☆85Updated 7 years ago
• haoheliu / AudioLDM-training-finetuning
  AudioLDM training, finetuning, evaluation and inference.
  ☆277Updated 10 months ago
• Sreyan88 / GAMA
  Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
  ☆144Updated 10 months ago
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆168Updated 6 months ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆57Updated last year
• wsntxxn / AudioCaption
  Audio captioning recipe
  ☆50Updated this week
• mct10 / RepCodec
  Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization
  ☆187Updated last year
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆257Updated last week
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆159Updated last month
• XinhaoMei / audio-text_retrieval
  Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'
  ☆49Updated 3 years ago
• AudioLLMs / AudioBench
  AudioBench: A Universal Benchmark for Audio Large Language Models
  ☆265Updated 4 months ago
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆46Updated 3 months ago
• Sakshi113 / MMAU
  ☆113Updated last month
• imxtx / awesome-controllable-speech-synthesis
  This is an evolving repo for the paper "Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey".
  ☆176Updated this week
• RicherMans / Dasheng
  Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"
  ☆73Updated 6 months ago
• liuxubo717 / LASS
  This repo hosts the code and model of "Separate What You Describe: Language-Queried Audio Source Separation", Interspeech 2022
  ☆145Updated 2 years ago
• sony / CLIPSep
  ☆42Updated 2 years ago
• zszheng147 / Spatial-AST
  🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)
  ☆60Updated 8 months ago
• microsoft / WavText5K
  Web-crawl for "Audio Retrieval with WavText5K and CLAP Training"
  ☆50Updated 2 years ago
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆92Updated last month
• ddlBoJack / MMAR
  [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  ☆169Updated 4 months ago
• choijeongsoo / av2av
  [CVPR 2024] AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
  ☆41Updated last year