Alternatives and similar repositories for WavCaps

Users that are interested in WavCaps are comparing it to the libraries listed below

• Labbeti / aac-datasets
  Audio Captioning datasets for PyTorch.
  ☆121Updated this week
• cdjkim / audiocaps
  🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps
  ☆176Updated 4 months ago
• OFA-Sys / AIR-Bench
  AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
  ☆106Updated 7 months ago
• cwx-worst-one / EAT
  [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer
  ☆166Updated 2 weeks ago
• microsoft / Pengi
  An Audio Language model for Audio Tasks
  ☆309Updated last year
• MorenoLaQuatra / audiocaps-download
  This package aims at simplifying the download of the AudioCaps dataset.
  ☆35Updated last year
• speedyseal / audiosetdl
  Scripts for download AudioSet
  ☆78Updated 7 years ago
• JishengBai / AudioSetCaps
  A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline
  ☆163Updated 7 months ago
• thuhcsi / SECap
  ☆169Updated last year
• XinhaoMei / audio-text_retrieval
  Implementation of our paper 'On Metric Learning For Audio-Text Cross-Modal Retrieval'
  ☆46Updated 3 years ago
• ddlBoJack / MMAR
  Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix
  ☆143Updated last month
• XinhaoMei / ACT
  Source code for the paper 'Audio Captioning Transformer'
  ☆54Updated 3 years ago
• zhenye234 / xcodec
  AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
  ☆226Updated 2 months ago
• roger-tseng / av-superb
  A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)
  ☆54Updated last year
• Sreyan88 / GAMA
  Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
  ☆134Updated 7 months ago
• v-iashin / Synchformer
  Source code for "Synchformer: Efficient Synchronization from Sparse Cues" (ICASSP 2024)
  ☆70Updated 5 months ago
• thuhcsi / SpeechCraft
  The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.
  ☆158Updated 2 months ago
• AudioLLMs / AudioBench
  AudioBench: A Universal Benchmark for Audio Large Language Models
  ☆231Updated 3 weeks ago
• haoheliu / AudioLDM-training-finetuning
  AudioLDM training, finetuning, evaluation and inference.
  ☆261Updated 7 months ago
• sony / CLIPSep
  ☆41Updated 2 years ago
• wsntxxn / TextToAudioGrounding
  The dataset and baseline code for Text-to-Audio Grounding (TAG)
  ☆42Updated last week
• joannahong / AV-RelScore
  Audio-Visual Corruption Modeling of our paper "Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling an…
  ☆34Updated 2 years ago
• Sakshi113 / MMAU
  ☆86Updated last week
• liuxubo717 / LASS
  This repo hosts the code and model of "Separate What You Describe: Language-Queried Audio Source Separation", Interspeech 2022
  ☆145Updated last year
• mct10 / RepCodec
  Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization
  ☆179Updated last year
• YuanGongND / ltu
  Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".
  ☆441Updated last year
• lmxue / Audio-FLAN
  Audio-FLAN
  ☆157Updated 4 months ago
• jaeyeonkim99 / EnCLAP
  Official Implementation of EnCLAP (ICASSP 2024)
  ☆92Updated last year
• YuanGongND / cav-mae
  Code and Pretrained Models for ICLR 2023 Paper "Contrastive Audio-Visual Masked Autoencoder".
  ☆264Updated last year
• zszheng147 / Spatial-AST
  🦇 Encoder of BAT (Learning to Reason about Spatial Sounds with Large Language Models)
  ☆57Updated 5 months ago