XinhaoMei / WavCaps
This reporsitory contains metadata of WavCaps dataset and codes for downstream tasks.
☆218Updated 6 months ago
Alternatives and similar repositories for WavCaps:
Users that are interested in WavCaps are comparing it to the libraries listed below
- Audio Captioning datasets for PyTorch.☆113Updated 3 months ago
- An Audio Language model for Audio Tasks☆301Updated 9 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆77Updated 2 months ago
- 🔊 Repository for our NAACL-HLT 2019 paper: AudioCaps☆151Updated 9 months ago
- This package aims at simplifying the download of the AudioCaps dataset.☆31Updated last year
- [IJCAI 2024] EAT: Self-Supervised Pre-Training with Efficient Audio Transformer☆130Updated last month
- AudioLDM training, finetuning, evaluation and inference.☆235Updated 2 months ago
- ☆151Updated 7 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆124Updated 3 weeks ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆116Updated 2 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆168Updated 7 months ago
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆148Updated last month
- PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.☆225Updated 4 months ago
- The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural language descriptions.☆87Updated last month
- MU-LLaMA: Music Understanding Large Language Model☆261Updated 10 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆128Updated 4 months ago
- Official Implementation of EnCLAP (ICASSP 2024)☆90Updated 8 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆139Updated last year
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆51Updated 9 months ago
- A Survey of Spoken Dialogue Models (60 pages)☆261Updated 2 months ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆525Updated 8 months ago
- The open source code for LLM-Codec☆126Updated 5 months ago
- VoiceLDM: Text-to-Speech with Environmental Context☆169Updated 6 months ago
- Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generati…☆180Updated 10 months ago
- Audio Codec Speech processing Universal PERformance Benchmark☆238Updated 3 months ago
- Code for the IEEE Signal Processing Letters 2022 paper "UAVM: Towards Unifying Audio and Visual Models".☆54Updated last year
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- Source for the Interspeech 2024 Paper "Scaling up masked audio encoder learning for general audio classification"☆51Updated last week
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆410Updated 9 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆107Updated 2 months ago