Alternatives and similar repositories for WavCaps:

Users that are interested in WavCaps are comparing it to the libraries listed below

• Labbeti / aac-datasets
  Audio Captioning datasets for PyTorch.
  ☆115Updated this week
• microsoft / Pengi
  An Audio Language model for Audio Tasks
  ☆301Updated 11 months ago
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆32Updated last year
• AudioLLMs / AudioBench
  AudioBench: A Universal Benchmark for Audio Large Language Models
  ☆161Updated this week
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆133Updated 2 months ago
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆157Updated 3 weeks ago
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆90Updated 9 months ago
• mct10 / RepCodec
  Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization
  ☆169Updated 8 months ago
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆81Updated 3 months ago
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆111Updated 2 months ago
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆119Updated 3 months ago
• 0nutation / USLM
  Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)
  ☆138Updated last year
• glory20h / VoiceLDM
  VoiceLDM: Text-to-Speech with Environmental Context
  ☆172Updated 7 months ago
• haoheliu / AudioLDM-training-finetuning
  AudioLDM training, finetuning, evaluation and inference.
  ☆239Updated 3 months ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆182Updated 2 months ago
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆53Updated 3 years ago
• RicherMans / Dasheng
  Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"
  ☆56Updated last month
• wsntxxn / AudioCaption
  Audio captioning recipe
  ☆46Updated 4 months ago
• wavlab-speech / versa
  Versatile Evaluation of Speech and Audio
  ☆169Updated this week
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆51Updated last month
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆178Updated 11 months ago
• microsoft / fadtk
  A simple library for Fréchet Audio Distance (FAD) calculation
  ☆184Updated 2 weeks ago
• Sakshi113 / MMAU
  ☆46Updated last month
• jishengpeng / WavChat
  A Survey of Spoken Dialogue Models (60 pages)
  ☆273Updated 3 months ago
• thuhcsi / SECap
  ☆159Updated 8 months ago
• zszheng147 / Spatial-AST
  🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)
  ☆45Updated last month
• shansongliu / MU-LLaMA
  MU-LLaMA: Music Understanding Large Language Model
  ☆269Updated 11 months ago
• ZhangXInFD / SpeechTokenizer
  This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…
  ☆530Updated 9 months ago
• X-LANCE / MSDWILD
  [INTERSPEECH 2022] This dataset is designed for multi-modal speaker diarization and lip-speech synchronization in the wild.
  ☆49Updated last year