Automated auditing pipeline for LLM and agent benchmarks — surfaces task ambiguity, environment conflicts, and evaluation bugs.
☆17May 27, 2026Updated 5 months ago
Alternatives and similar repositories for auto-bench-audit
Users that are interested in auto-bench-audit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- What LLMs Think When You Don’t Tell Them What to Think About?☆15Feb 4, 2026Updated 9 months ago
- ReasonIF: Large Language Models Fail to Follow Instructions During Reasoning☆16Oct 22, 2025Updated last year
- ☆53Oct 26, 2026Updated 3 weeks ago
- ☆20Oct 22, 2026Updated 3 weeks ago
- ☆10Nov 8, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Dataset and Results for Classifying Emotions Across Languages☆10Jun 20, 2021Updated 5 years ago
- Unleash LLMs Potential for Sequential Recommendation by Coordinating Dual Dynamic Index Mechanism. WebConf 2025 (Oral).☆12May 25, 2026Updated 5 months ago
- In-context Example Selection with Influences☆15May 12, 2023Updated 3 years ago
- ☆16May 1, 2026Updated 6 months ago
- ☆13May 28, 2018Updated 8 years ago
- [CIKM 2024] Do We Really Need Graph Convolution During Training? Light Post-Training Graph-ODE for Efficient Recommendation☆13Aug 11, 2024Updated 2 years ago
- KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)☆25Apr 11, 2022Updated 4 years ago
- static-dir files for a simple-server demo with ReactJS visualizations☆16Nov 28, 2018Updated 7 years ago
- ☆12Mar 2, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Saliency calculation module for Chainer☆12May 28, 2019Updated 7 years ago
- Tutorial notebooks for SciFM24☆11Apr 2, 2024Updated 2 years ago
- RAL - Reinforced stream-based Active Learning☆10Aug 22, 2019Updated 7 years ago
- Automatically modelling and distilling knowledge within AI. In other words, summarising the AI research firehose.☆26Mar 15, 2019Updated 7 years ago
- ☆14Sep 10, 2024Updated 2 years ago
- Unsupervised fingerprinting of disordered solids leading to analogical materials discovery.☆11Feb 14, 2023Updated 3 years ago
- A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.☆21Apr 8, 2025Updated last year
- ☆12May 8, 2026Updated 6 months ago
- Study materials about "Deep Learning for Molecular Applications".☆15Aug 5, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is the Pytorch implementation of paper--Training deep neural-networks using a noise adaptation layer.☆10Apr 18, 2021Updated 5 years ago
- New state-of-the-art bounds for open problems☆126Apr 12, 2026Updated 7 months ago
- Batch Multi-Fidelity Bayesian Optimization with Deep Auto-Regressive Networks☆12Nov 3, 2021Updated 5 years ago
- ☆11Sep 16, 2023Updated 3 years ago
- ☆18Jul 28, 2026Updated 3 months ago
- A phase field method for lithium dendrite☆16Oct 19, 2022Updated 4 years ago
- Implementation of various deep neural networks on fashion-mnist with PyTorch☆14Aug 30, 2017Updated 9 years ago
- ☆10Jan 20, 2024Updated 2 years ago
- A controllable and interactive simulation framework for vision research.☆17May 25, 2026Updated 5 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Source Code for <Target-Side Data Augmentation for Sequence Generation>☆12Oct 6, 2021Updated 5 years ago
- TFT (Training from Traces) benchmark: 5 scenarios comparing TFT pipeline vs Direct Training on SGD restaurant traces☆13Sep 7, 2026Updated 2 months ago
- Official Repository for EvalRS @ KDD 2023: a Rounded Evaluation of Recommender Systems☆30Feb 16, 2024Updated 2 years ago
- Shared code for training sentence embeddings with Flax / JAX☆28Jul 15, 2021Updated 5 years ago
- ☆13Apr 3, 2025Updated last year
- Official Codebase for .☆18Oct 25, 2026Updated 3 weeks ago
- Implementation of the MuonClip optimizer in PyTorch/JAX based on the Kimi K2 technical report☆10Jul 24, 2025Updated last year
Are these results useful?