Automated auditing pipeline for LLM and agent benchmarks — surfaces task ambiguity, environment conflicts, and evaluation bugs.
☆17May 27, 2026Updated 5 months ago
Alternatives and similar repositories for auto-bench-audit
Users that are interested in auto-bench-audit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- What LLMs Think When You Don’t Tell Them What to Think About?☆15Feb 4, 2026Updated 8 months ago
- ReasonIF: Large Language Models Fail to Follow Instructions During Reasoning☆16Oct 22, 2025Updated last year
- ☆53Oct 22, 2026Updated last week
- What Effort Level Should I Choose? On the Economics of Reasoning Effort in LLM Agents☆45Updated this week
- ☆20Oct 22, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Nov 1, 2022Updated 3 years ago
- ☆10Nov 8, 2022Updated 3 years ago
- A Dataset and Results for Classifying Emotions Across Languages☆10Jun 20, 2021Updated 5 years ago
- Tencent Cloud API 3.0 SDK for Python☆15Updated this week
- ☆12Oct 25, 2023Updated 3 years ago
- Urban Generative Intelligence (UGI): A Foundational Platform for Embodied Agent and Future City☆12Dec 17, 2023Updated 2 years ago
- OpenCity: A Scalable Platform to Simulate Urban Activities with Massive LLM Agents☆15May 27, 2026Updated 5 months ago
- Unsupervised fingerprinting of disordered solids leading to analogical materials discovery.☆11Feb 14, 2023Updated 3 years ago
- ☆12Mar 2, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- In-context Example Selection with Influences☆15May 12, 2023Updated 3 years ago
- Saliency calculation module for Chainer☆12May 28, 2019Updated 7 years ago
- ☆10Jun 4, 2021Updated 5 years ago
- Tutorial notebooks for SciFM24☆11Apr 2, 2024Updated 2 years ago
- Automatically modelling and distilling knowledge within AI. In other words, summarising the AI research firehose.☆26Mar 15, 2019Updated 7 years ago
- A phase field method for lithium dendrite☆16Oct 19, 2022Updated 4 years ago
- ☆13May 28, 2018Updated 8 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)☆25Apr 11, 2022Updated 4 years ago
- Official repository for OMG-Avatar (CVPR 2026)☆18Jul 31, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆14Sep 10, 2024Updated 2 years ago
- static-dir files for a simple-server demo with ReactJS visualizations☆16Nov 28, 2018Updated 7 years ago
- ☆20Apr 12, 2024Updated 2 years ago
- A holistic framework for advancing LLMs as data science agents☆61May 19, 2026Updated 5 months ago
- ☆18Jul 28, 2026Updated 3 months ago
- RAL - Reinforced stream-based Active Learning☆10Aug 22, 2019Updated 7 years ago
- Acanvas: canvas for agent-ready harnesses☆31Oct 18, 2026Updated last week
- Implementation of various deep neural networks on fashion-mnist with PyTorch☆14Aug 30, 2017Updated 9 years ago
- ☆19Jan 12, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected…☆23Nov 9, 2020Updated 5 years ago
- Image Analysis Project: Built a system to take images of receipts or invoices as input and segment the text on the receipt. Using Tessera…☆21Dec 3, 2015Updated 10 years ago
- A Domain-Specific Language, Jailbreak Attack Synthesizer and Dynamic LLM Redteaming Toolkit☆28Dec 5, 2024Updated last year
- A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.☆21Apr 8, 2025Updated last year
- ☆14Mar 2, 2023Updated 3 years ago
- Official Codebase for .☆18Aug 4, 2026Updated 2 months ago
- Multiphysics Object Oriented Simulation Environment In Julia☆17Dec 18, 2016Updated 9 years ago