The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.
☆967Nov 16, 2026Updated this week
Alternatives and similar repositories for audio-ai-hub
Users that are interested in audio-ai-hub are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AudioBench: A Universal Benchmark for Audio Large Language Models☆334May 29, 2026Updated 5 months ago
- Awesome speech/audio LLMs, representation learning, and codec models☆1,250Jul 10, 2026Updated 4 months ago
- [TACL'26] VoiceBench: Benchmarking LLM-Based Voice Assistants☆411Sep 28, 2026Updated last month
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆1,072Jan 15, 2026Updated 10 months ago
- A Survey of Spoken Dialogue Models (60 pages)☆317Nov 28, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- PyTorch implementation of Audio Flamingo: Series of Advanced Audio Understanding Language Models☆1,223Dec 15, 2025Updated 11 months ago
- Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.☆748Nov 2, 2026Updated 2 weeks ago
- Awesome Neural Codec Models, Text-to-Speech Synthesizers & Speech Language Models☆246Oct 21, 2026Updated 3 weeks ago
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆225Feb 25, 2026Updated 8 months ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆667Jun 9, 2024Updated 2 years ago
- A 6-million Audio-Caption Paired Dataset Built with a LLMs and ALMs-based Automatic Pipeline☆210Dec 13, 2024Updated last year
- Audio Codec Speech processing Universal PERformance Benchmark☆312Jul 4, 2026Updated 4 months ago
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆206Jun 7, 2026Updated 5 months ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆481Apr 24, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The Open Source Code of UniAudio☆610Jul 22, 2024Updated 2 years ago
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆222Sep 19, 2024Updated 2 years ago
- Update ASR paper everyday☆513May 16, 2026Updated 6 months ago
- SALMONN family: A suite of advanced multi-modal LLMs☆1,576Oct 16, 2026Updated last month
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆221Feb 28, 2025Updated last year
- ☆163Feb 9, 2026Updated 9 months ago
- Audio-FLAN☆164Sep 23, 2025Updated last year
- AAAI 2025: Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆316Nov 10, 2026Updated last week
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆536Nov 1, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The open source code for LLM-Codec☆147Aug 18, 2024Updated 2 years ago
- Keep track of big models in audio domain, including speech, singing, music etc.☆523Jul 3, 2026Updated 4 months ago
- Your faithful, impartial partner for audio evaluation — know yourself, know your rivals. 真实评测,知己知彼。A unified benchmark framework for ASR/…☆329Nov 3, 2026Updated 2 weeks ago
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆331Mar 18, 2026Updated 8 months ago
- small audio language model for reasoning☆90Dec 4, 2025Updated 11 months ago
- SSR-Speech: Towards Stable, Safe and Robust Zero-shot Speech Editing and Synthesis☆160Jan 1, 2025Updated last year
- A family of state-of-the-art Transformer-based audio codecs for low-bitrate high-quality audio coding.☆446Jul 17, 2026Updated 4 months ago
- [ACM Multimedia 24]The official repository of SpeechCraft dataset, a large-scale expressive bilingual speech dataset with natural languag…☆203Feb 28, 2026Updated 8 months ago
- 语音方向实验室/公司/资源/实习等,欢迎推荐或自荐☆612Nov 13, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- SpeechGPT Series: Speech Large Language Models☆1,401Jul 22, 2024Updated 2 years ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆152Dec 5, 2024Updated last year
- Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation☆410Nov 2, 2025Updated last year
- 🤗 R1-AQA Model: mispeech/r1-aqa☆328Mar 28, 2025Updated last year
- OSUM & OSUM-EChat, open speech understanding model and empathetic spoken chatbot based on it, open-sourced by ASLP@NPU.☆501Nov 23, 2025Updated 11 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆254Mar 26, 2025Updated last year
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆450Jan 25, 2024Updated 2 years ago
Are these results useful?