AudioLLMs / Awesome-Audio-LLM
Audio Large Language Models
☆480Updated 2 weeks ago
Alternatives and similar repositories for Awesome-Audio-LLM:
Users that are interested in Awesome-Audio-LLM are comparing it to the libraries listed below
- Awesome speech/audio LLMs, representation learning, and codec models☆938Updated this week
- A Survey of Spoken Dialogue Models (60 pages)☆277Updated 4 months ago
- This is the code for the SpeechTokenizer presented in the SpeechTokenizer: Unified Speech Tokenizer for Speech Language Models. Samples a…☆537Updated 9 months ago
- Automatically Update Text-to-speech (TTS) Papers Daily using Github Actions (Update Every 12th hours)☆389Updated this week
- Paper, Code and Resources for Speech Language Model and End2End Speech Dialogue System.☆162Updated 4 months ago
- Keep track of big models in audio domain, including speech, singing, music etc.☆474Updated 6 months ago
- Speech, Language, Audio, Music Processing with Large Language Model☆757Updated 2 weeks ago
- Collection of resources on the applications of Large Language Models (LLMs) in Audio AI.☆661Updated 7 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆171Updated this week
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆419Updated 11 months ago
- VoiceBench: Benchmarking LLM-Based Voice Assistants☆151Updated 2 weeks ago
- Multi-Scale Neural Audio Codec (SNAC) compresses audio into discrete codes at a low bitrate☆515Updated 4 months ago
- Daily tracking of awesome audio papers, including music generation, zero-shot tts, asr, audio generation☆375Updated last week
- PyTorch implementation of Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities.☆400Updated this week
- Update ASR paper everyday☆172Updated this week
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆83Updated 3 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆294Updated 2 months ago
- [INTERSPEECH 2024] EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark☆213Updated 9 months ago
- Reverse Engineering of Supervised Semantic Speech Tokenizer (S3Tokenizer) proposed in CosyVoice☆270Updated 2 months ago
- FunCodec is a research-oriented toolkit for audio quantization and downstream applications, such as text-to-speech synthesis, music gener…☆392Updated last year
- Real-time Speech-Text Foundation Model Toolkit (wip)☆203Updated this week
- The official repository of Dynamic-SUPERB.☆176Updated last week
- Paper, Code and Statistics for Self-Supervised Learning and Pre-Training on Speech.☆205Updated last year
- EMNLP 23 - Integrating Whisper Encoder to LLaMA Decoder for Generative ASR Error Correction☆251Updated 10 months ago
- ☆352Updated 6 months ago
- Some comprehensive papers about speaker diarization☆266Updated last month
- An evolving, large-scale and multi-domain ASR corpus for low-resource languages with automated crawling, transcription and refinement☆148Updated 2 weeks ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆118Updated 3 months ago
- Codec for paper: LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis☆235Updated 2 weeks ago
- 🤗 R1-AQA Model: mispeech/r1-aqa☆197Updated last week