ServiceNow / AU-HarnessLinks
A comprehensive framework to test audio comprehension of Large Audio Language Models.
☆58Updated last week
Alternatives and similar repositories for AU-Harness
Users that are interested in AU-Harness are comparing it to the libraries listed below
Sorting:
- ☆51Updated last month
- ☆77Updated 4 months ago
- ☆132Updated this week
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆86Updated 3 weeks ago
- A project for tri-modal LLM benchmarking and instruction tuning.☆56Updated 10 months ago
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆131Updated 4 months ago
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆85Updated 7 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Updated last year
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆127Updated last year
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆188Updated last month
- AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025)☆41Updated last year
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated last year
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆67Updated last year
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆48Updated 5 months ago
- small audio language model for reasoning☆86Updated last month
- Evaluate your agent memory on real-world dialogues, not LLM-simulated dialogues.☆36Updated 6 months ago
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆38Updated last year
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆54Updated 11 months ago
- AudioBench: A Universal Benchmark for Audio Large Language Models☆294Updated 7 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- trying to reproduce suno v3☆35Updated last year
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆46Updated 4 months ago
- ☆29Updated 6 months ago
- Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities☆150Updated last year
- A spoken version of the textual story cloze benchmark☆20Updated 2 years ago
- ☆50Updated last year
- Code for NeurIPS 2023 paper "DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translation".☆63Updated last year
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Updated last year
- Code for the blog "Neural audio codecs: how to get audio into LLMs"☆149Updated 3 months ago
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆24Updated 7 months ago