ServiceNow / AU-HarnessLinks
A comprehensive framework to test audio comprehension of Large Audio Language Models.
☆58Updated 2 weeks ago
Alternatives and similar repositories for AU-Harness
Users that are interested in AU-Harness are comparing it to the libraries listed below
Sorting:
- ☆51Updated 2 months ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆86Updated last month
- ☆77Updated 4 months ago
- ☆131Updated last week
- A unified tokenizer that is capable of both extracting semantic information and enabling high-fidelity audio reconstruction.☆132Updated 4 months ago
- The official code for the SALMon🍣 benchmark (ICASSP 2025 - Oral)☆48Updated 5 months ago
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆54Updated 11 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆16Updated last year
- A project for tri-modal LLM benchmarking and instruction tuning.☆56Updated 10 months ago
- AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension☆127Updated last year
- We introduce the LLAMA1 Test Set, a comprehensive open-domain world knowledge QA dataset for evaluating question-answering systems. We pr…☆23Updated last year
- Implementation of Google's USM speech model in Pytorch☆34Updated 3 weeks ago
- small audio language model for reasoning☆86Updated 2 months ago
- This is the official repository of the papers "Parameter-Efficient Transfer Learning of Audio Spectrogram Transformers" and "Efficient Fi…☆38Updated last year
- [NeurIPS' 25] Benchmark for evaluating TTS models on complex prosodic, expressiveness, and linguistic challenges.☆189Updated 2 months ago
- Implementation of the model "AudioFlamingo" from the paper: "Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dial…☆40Updated last year
- Code for the blog "Neural audio codecs: how to get audio into LLMs"☆149Updated 3 months ago
- A Foundation Model for Industrial Signal Comprehensive Representation☆57Updated 6 months ago
- AudioBERT 📢 : Audio Knowledge Augmented Language Model (ICASSP 2025)☆41Updated last year
- Official repository of the IEEE SLT 2024 paper "Self-Supervised Syllable Discovery Based on Speaker-Disentangled HuBERT"☆45Updated this week
- LSLM implements full duplex modeling in interactive speech language models, based on research by Ma et al. (2024). This project advances …☆85Updated 7 months ago
- [ACL 2024] Generative Pre-Trained Speech Language Model with Efficient Hierarchical Transformer☆67Updated last year
- Ke-Omni-R is an advanced audio reasoning model and achieved SOTA on MMAU☆60Updated 7 months ago
- The official implementation of the DIFFA series for dLLM-based large audio language model☆56Updated last week
- Github repository for ACL 2025 paper: VoxEval: Benchmarking the Knowledge Understanding Capabilities of End-to-End Spoken Language Models☆24Updated 7 months ago
- Audio tokenization, in the fastest way possible!☆53Updated last year
- SLMTokBench for paper "SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models"☆37Updated 2 years ago
- Towards Comprehensive Evaluation for End-to-End Spoken Dialogue Models☆50Updated 5 months ago
- Understanding and Tackling Hallucinations in Large Audio-Language Models | ICASSP 2025, Interspeech 2024☆32Updated 10 months ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆110Updated 8 months ago