Collection of works for evaluating (and analyzing) large audio-language models (LALMs)
☆41Aug 11, 2025Updated last year
Alternatives and similar repositories for LALM-Evaluation-Survey
Users that are interested in LALM-Evaluation-Survey are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official GitHub repository for paper "SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Informa…☆24Aug 14, 2025Updated last year
- Code for DeSTA2.5-Audio, general-purpose LALM☆142Feb 4, 2026Updated 9 months ago
- Explaining audio differences using language☆17Feb 11, 2025Updated last year
- Code and model for ICASSP 2025 Paper "Developing Instruction-Following Speech Language Model Without Speech Instruction-Tuning Data"☆127Jul 15, 2025Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆56Jun 25, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the official train-dev-test release of the Interspeech2024 Discrete Speech Representation Challenge.☆32Jan 26, 2024Updated 2 years ago
- [INTERSPEECH 2023 Best Paper Shortlist] Official implementation for MT4SSL: Boosting Self-Supervised Speech Representation Learning by In…☆45Mar 25, 2024Updated 2 years ago
- ☆161Feb 9, 2026Updated 8 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆135Dec 9, 2024Updated last year
- The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Compre…☆20Oct 30, 2023Updated 3 years ago
- A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)☆58Apr 17, 2024Updated 2 years ago
- A survey of spoken dialogue models (SDMs) with speech input and speech output. Focus on their Intermediate Representation and Generation …☆32Mar 24, 2026Updated 7 months ago
- HighRateMOS is the first non-intrusive MOS prediction model that explicitly models sampling rates, achieving first place in five out of e…☆12Mar 14, 2026Updated 7 months ago
- 《SpeechGen: Unlocking the Generative Power of Speech Language Models with Prompts》☆77Jun 9, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Leaderboard and code for "Speech-IFEval", Interspeech 2025☆25May 27, 2025Updated last year
- The official repository of Dynamic-SUPERB.☆201Jun 24, 2025Updated last year
- ☆12Jan 9, 2025Updated last year
- Official release of StyleTalk dataset.☆76Jul 1, 2024Updated 2 years ago
- ☆13Sep 25, 2024Updated 2 years ago
- Repository for "Training Audio Captioning Models without Audio"☆10Sep 26, 2023Updated 3 years ago
- Audio Research in US. US-based professors who work on audio (music, speech, acoustics). For students who would like to apply for RA, PhD,…☆34Feb 27, 2026Updated 8 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Oct 11, 2022Updated 4 years ago
- ☆14Mar 18, 2026Updated 7 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [NeurIPS 2025] Benchmark data and code for MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix☆223Feb 25, 2026Updated 8 months ago
- Code for the paper: MACE: Leveraging Audio for Evaluating Audio Captioning Systems☆13Jan 16, 2025Updated last year
- LLM-Codec: Neural Audio Codec Meets Language Model Objectives☆23May 3, 2026Updated 6 months ago
- Audio Entailment: Deductive Reasoning for Audio Understanding☆17Dec 10, 2024Updated last year
- Speech Security and Privacy Compendium - Mini☆10Jun 18, 2024Updated 2 years ago
- 《SpeechPrompt v2: Prompt Tuning for Speech Classification Tasks》Speech processing with prompting paradigm☆81Oct 19, 2023Updated 3 years ago
- small audio language model for reasoning☆90Dec 4, 2025Updated 11 months ago
- Code, Dataset, and Pretrained Models for Audio and Speech Large Language Model "Listen, Think, and Understand".☆480Apr 24, 2024Updated 2 years ago
- OTTC: Optimal Temporal Transport Classification☆15Dec 17, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Speech Human Evaluation Estimation Toolkit (SHEET)☆142Mar 31, 2026Updated 7 months ago
- A deepfake audio dataset for detecting fake speech from codec-based speech synthesis systems, Interspeech 2024☆22Jul 27, 2024Updated 2 years ago
- Audio-Oscar is a multi-agent framework for generating long-form, controllable audio from complex audio scene descriptions.☆69Jun 8, 2026Updated 4 months ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆57May 15, 2025Updated last year
- Official implementation of the Odyssey paper "A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification"☆18Jun 24, 2022Updated 4 years ago
- Code for T5lephone: Bridging Speech and Text Self-supervised Models for Spoken Language Understanding via Phoneme level T5☆19Nov 29, 2022Updated 3 years ago
- Taiwanese Speech Synthesis with Tacotron2☆26Oct 2, 2022Updated 4 years ago