Alternatives and similar repositories for WavCaps:

Users that are interested in WavCaps are comparing it to the libraries listed below

• Labbeti / aac-datasets
  Audio Captioning datasets for PyTorch.
  ☆113Updated 2 months ago
• microsoft / Pengi
  An Audio Language model for Audio Tasks
  ☆298Updated 9 months ago
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆31Updated last year
• mct10 / RepCodec
  Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization
  ☆166Updated 6 months ago
• NVIDIA / audio-flamingo
  PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.
  ☆223Updated 3 months ago
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆149Updated 9 months ago
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆124Updated last month
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆90Updated 7 months ago
• haoheliu / AudioLDM-training-finetuning
  AudioLDM training, finetuning, evaluation and inference.
  ☆231Updated last month
• happylittlecat2333 / Auffusion
  Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…
  ☆168Updated 10 months ago
• shansongliu / MU-LLaMA
  MU-LLaMA: Music Understanding Large Language Model
  ☆257Updated 10 months ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆144Updated 3 weeks ago
• thuhcsi / SECap
  ☆149Updated 6 months ago
• 0nutation / USLM
  Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)
  ☆140Updated last year
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆72Updated last month
• jishengpeng / WavChat
  A Survey of Spoken Dialogue Models (60 pages)
  ☆251Updated 2 months ago
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆112Updated last month
• voidful / Codec-SUPERB
  Audio Codec Speech processing Universal PERformance Benchmark
  ☆238Updated 2 months ago
• shinjiwlab / versa
  Versatile Evaluation of Speech and Audio
  ☆153Updated 3 weeks ago
• Sreyan88 / GAMA
  Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
  ☆102Updated last month
• AudioLLMs / AudioBench
  AudioBench: A Universal Benchmark for Audio Large Language Models
  ☆116Updated last week
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆82Updated 3 weeks ago
• yangdongchao / RSTnet
  Real-time Speech-Text Foundation Model Toolkit (wip)
  ☆126Updated 3 months ago
• seungheondoh / music_caps_dl
  Unofficial download repository for MusicCaps
  ☆45Updated last year
• lucasnewman / best-rq-pytorch
  Implementation of BEST-RQ - a model for self-supervised learning of speech signals using a random projection quantizer, in Pytorch.
  ☆109Updated last year
• yangdongchao / LLM-Codec
  The open source code for LLM-Codec
  ☆123Updated 5 months ago
• YuanGongND / uavm
  Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".
  ☆54Updated last year
• YuanGongND / ltu
  Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".
  ☆409Updated 9 months ago
• glory20h / VoiceLDM
  VoiceLDM: Text-to-Speech with Environmental Context
  ☆168Updated 5 months ago
• wsntxxn / AudioCaption
  Audio captioning recipe
  ☆45Updated 2 months ago