ServiceNow / AU-HarnessLinks
A comprehensive framework to test audio comprehension of Large Audio Language Models.
☆56Updated this week
Alternatives and similar repositories for AU-Harness
Users that are interested in AU-Harness are comparing it to the libraries listed below
Sorting:
- ☆49Updated 3 months ago
- ☆118Updated 2 months ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆84Updated 2 months ago
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆23Updated 5 months ago
- ☆70Updated 2 months ago
- ☆19Updated 5 months ago
- Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.☆35Updated 4 months ago
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆47Updated 3 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated 10 months ago
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆15Updated last year
- Understanding and Tackling Hallucinations in Large Audio-Language Models | ICASSP 2025, Interspeech 2024☆30Updated 8 months ago
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆87Updated 2 weeks ago
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆51Updated 9 months ago
- ☆38Updated last year
- A spoken version of the textual story cloze benchmark☆19Updated 2 years ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆66Updated last year
- AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025)☆41Updated 10 months ago
- small audio language model for reasoning☆80Updated 7 months ago
- Implementation of Google's USM speech model in Pytorch☆33Updated last month
- Official repository of the IEEE SLT 2024 paper "Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT"☆44Updated 2 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆124Updated 11 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Updated 2 years ago
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆41Updated 2 months ago
- Interface Design for Self-Supervised Speech Models, Accepted to Interspeech2024☆16Updated last year
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆82Updated 5 months ago
- Audio Entailment: Deductive Reasoning for Audio Understanding☆16Updated 11 months ago
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆121Updated 2 months ago
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated last year
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆177Updated last month