AudioLLMs / AudioBench
AudioBench: A Universal Benchmark for Audio Large Language Models
☆89Updated last month
Related projects ⓘ
Alternatives and complementary repositories for AudioBench
- The open source code for LLM-Codec☆114Updated 2 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆77Updated 3 months ago
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model☆102Updated last month
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Updated last year
- ConMamba for Automatic Speech Recognition☆44Updated 2 months ago
- Models and code for RepCodec: A Speech Representation Codec for Speech Tokenization☆157Updated 3 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆50Updated 2 months ago
- Unified Speech Language Model for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"(ICLR 2024)☆136Updated last year
- Implementation of the paper "Self-supervised Learning with Random-projection Quantizer for Speech Recognition" in Pytorch.☆58Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆42Updated 4 months ago
- Official implementation for Fast-HuBERT: An Efficient Training Framework for Self-Supervised Speech Representation Learning☆81Updated last week
- ARCH: Audio Representations benCHmark☆35Updated 2 months ago
- [AAAI 2024] Code for CTX-vec2wav in UniCATS☆122Updated 4 months ago
- Reference-aware automatic speech evaluation toolkit☆106Updated 8 months ago
- Generative Expressive Conversational Speech Synthesis (Accepted by MM'2024)☆38Updated last week
- Real-time Speech-Text Foundation Model Toolkit (wip)☆119Updated 3 weeks ago
- Official release of StyleTalk dataset.☆57Updated 4 months ago
- ☆62Updated 9 months ago
- The open source code for SimpleSpeech series☆108Updated last month
- Evaluation Protocol for Large-Scale Zero-Shot TTS Literature☆64Updated last month
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning☆114Updated 4 months ago
- [AAAI 2024] CTX-txt2vec, the acoustic model in UniCATS☆63Updated 8 months ago
- Implementation of CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning☆46Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆33Updated last year
- Official implementation of the paper "BigCodec: Pushing the Limits of Low-Bitrate Neural Speech Codec"☆82Updated last month
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆33Updated last week
- This is a list of speech tasks and datasets, which can provide training data for Generative AI, AIGC, AI model training, intelligent spee…☆72Updated 5 months ago
- List of direct speech-to-speech translation papers.☆31Updated last year
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆46Updated last month