ServiceNow / AU-HarnessLinks
A comprehensive framework to test audio comprehension of Large Audio Language Models.
☆54Updated last month
Alternatives and similar repositories for AU-Harness
Users that are interested in AU-Harness are comparing it to the libraries listed below
Sorting:
- ☆49Updated 2 months ago
- ☆114Updated last month
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆81Updated last month
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆47Updated 2 months ago
- Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.☆31Updated 3 months ago
- ☆67Updated last month
- ☆19Updated 4 months ago
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆51Updated 8 months ago
- AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025)☆41Updated 9 months ago
- A Foundation Model for Industrial Signal Comprehensive Representation☆47Updated 2 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆124Updated 10 months ago
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆84Updated 2 weeks ago
- ☆47Updated last year
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆172Updated 2 weeks ago
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆81Updated 4 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆39Updated 9 months ago
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆53Updated 4 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆15Updated last year
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Updated last year
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆107Updated last month
- Understanding and Tackling Hallucinations in Large Audio-Language Models | ICASSP 2025, Interspeech 2024☆29Updated 7 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆65Updated last year
- Official repository of the IEEE SLT 2024 paper "Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT"☆43Updated last month
- A spoken version of the textual story cloze benchmark☆19Updated 2 years ago
- Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models☆41Updated 2 months ago
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Updated 2 years ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆269Updated 4 months ago
- LongCat Audio Tokenizer and Detokenizer☆178Updated last week
- ☆41Updated last year
- ☆38Updated last year