Alternatives and similar repositories for WavCaps

Users that are interested in WavCaps are comparing it to the libraries listed below

• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆153Updated 3 weeks ago
• Labbeti / aac-datasets
  Audio Captioning datasets for PyTorch.
  ☆117Updated last week
• microsoft / Pengi
  An Audio Language model for Audio Tasks
  ☆304Updated last year
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆102Updated 5 months ago
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆172Updated 3 months ago
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆133Updated 5 months ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆209Updated last month
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆35Updated last year
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆153Updated 2 months ago
• mct10 / RepCodec
  Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization
  ☆179Updated 10 months ago
• thuhcsi / SECap
  ☆163Updated 10 months ago
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆182Updated last year
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆133Updated last month
• Sreyan88 / GAMA
  Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
  ☆127Updated 5 months ago
• haoheliu / AudioLDM-training-finetuning
  AudioLDM training, finetuning, evaluation and inference.
  ☆248Updated 5 months ago
• 0nutation / USLM
  Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)
  ☆145Updated last year
• luosiallen / Diff-Foley
  Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models
  ☆186Updated last year
• Sakshi113 / MMAU
  ☆79Updated this week
• jishengpeng / WavChat
  A Survey of Spoken Dialogue Models (60 pages)
  ☆299Updated 6 months ago
• glory20h / VoiceLDM
  VoiceLDM: Text-to-Speech with Environmental Context
  ☆177Updated 9 months ago
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆91Updated 11 months ago
• AudioLLMs / AudioBench
  AudioBench: A Universal Benchmark for Audio Large Language Models
  ☆215Updated last week
• shansongliu / MU-LLaMA
  MU-LLaMA: Music Understanding Large Language Model
  ☆275Updated last year
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆62Updated 3 months ago
• sarulab-speech / UTMOSv2
  UTokyo-SaruLab MOS Prediction System
  ☆185Updated this week
• ddlBoJack / Awesome-Speech-Pretraining
  Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.
  ☆206Updated last year
• wavlab-speech / versa
  Versatile Evaluation of Speech and Audio
  ☆260Updated this week
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆51Updated last year
• lifeiteng / naturalspeech3_facodec
  FACodec: Speech Codec with Attribute Factorization used for NaturalSpeech 3
  ☆200Updated last year
• RicherMans / Dasheng
  Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"
  ☆65Updated last month