ServiceNow / AU-HarnessLinks
A comprehensive framework to test audio comprehension of Large Audio Language Models.
☆58Updated 2 weeks ago
Alternatives and similar repositories for AU-Harness
Users that are interested in AU-Harness are comparing it to the libraries listed below
Sorting:
- ☆51Updated 2 months ago
- ☆77Updated 4 months ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆86Updated last month
- ☆131Updated last week
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆132Updated 4 months ago
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆48Updated 5 months ago
- A Foundation Model for Industrial Signal Comprehensive Representation☆57Updated 6 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆67Updated last year
- Audio Entailment: Deductive Reasoning for Audio Understanding☆17Updated last year
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆127Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Updated last year
- OpenS2S : Advancing Fully Open-Source End-to-End Empathetic Large Speech Language Model☆109Updated 6 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated last year
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆85Updated 7 months ago
- ☆29Updated 7 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- The official implementation of the DIFFA series for dLLM-based large audio language model☆59Updated last week
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆54Updated 11 months ago
- Official repository of the IEEE SLT 2024 paper "Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT"☆45Updated this week
- AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025)☆41Updated last year
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Updated last year
- Understanding and Tackling Hallucinations in Large Audio-Language Models | ICASSP 2025, Interspeech 2024☆32Updated 10 months ago
- Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.☆36Updated 7 months ago
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆189Updated 2 months ago
- Code for the blog "Neural audio codecs: how to get audio into LLMs"☆149Updated 3 months ago
- An official implementation of Style-Talker for Spoken Dialogue Generation☆23Updated last year
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆24Updated 7 months ago
- ☆38Updated last year
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆47Updated 4 months ago
- Implementation of Google's USM speech model in Pytorch☆34Updated 3 weeks ago