AudioLLMs / Awesome-Audio-LLM
Audio Large Language Models
☆501Updated last month
Alternatives and similar repositories for Awesome-Audio-LLM:
Users that are interested in Awesome-Audio-LLM are comparing it to the libraries listed below
- A Survey of Spoken Dialogue Models (60 pages)☆287Updated 4 months ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆549Updated 10 months ago
- Awesome speech/audio LLMs, representation learning, and codec models☆967Updated this week
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆459Updated this week
- AudioBench: A Universal Benchmark for Audio Large Language Models☆200Updated 3 weeks ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆427Updated last year
- Speech, Language, Audio, Music Processing with Large Language Model☆787Updated this week
- Automatically Update Text-to-speech (TTS) Papers Daily using Github Actions (Update Every 12th hours)☆409Updated this week
- Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.☆669Updated 8 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆177Updated last week
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆220Updated 3 weeks ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆309Updated 3 months ago
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆164Updated 5 months ago
- Keep track of big models in audio domain, including speech, singing, music etc.☆476Updated 6 months ago
- Update ASR paper everyday☆196Updated this week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆92Updated 4 months ago
- 🤗 R1-AQA Model: mispeech/r1-aqa☆236Updated 3 weeks ago
- Baichuan-Audio: A Unified Framework for End-to-End Speech Interaction☆180Updated last month
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆396Updated last year
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆555Updated 5 months ago
- The Open Source Code of UniAudio☆555Updated 9 months ago
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆289Updated 3 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆123Updated 4 months ago
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆251Updated 11 months ago
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆253Updated last month
- The official repository of Dynamic-SUPERB.☆178Updated last month
- Unified automatic quality assessment for speech, music, and sound.☆459Updated 2 weeks ago
- An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement☆152Updated last month
- Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation☆379Updated this week
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆205Updated last year