Collection of evals for Inspect AI
☆710Oct 22, 2026Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect: A framework for large language model evaluations☆3,062Updated this week
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆255Oct 13, 2026Updated last week
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆23Updated this week
- Data visualization for Inspect AI large language model evalutions.☆24Updated this week
- In-depth analysis of AI agent transcripts.☆83Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆58Sep 9, 2026Updated last month
- METR Task Standard☆198Oct 7, 2026Updated 2 weeks ago
- An Inspect extension for agentic cyber evaluations☆43Jun 18, 2026Updated 4 months ago
- Integration between Inspect and Weights & Biases☆24Oct 7, 2026Updated 2 weeks ago
- A Kubernetes sandbox environment for use with inspect_ai☆42Updated this week
- Running UK AISI's Inspect in the Cloud☆25May 6, 2026Updated 5 months ago
- ☆1,373Updated this week
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆144Oct 7, 2026Updated 2 weeks ago
- Software Engineering Agents for Inspect AI☆39Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆1,386Updated this week
- The open-source AISI toolkit for sandboxing agentic evaluations☆36Aug 7, 2025Updated last year
- Inference API for many LLMs and other useful tools for empirical research☆141May 29, 2026Updated 4 months ago
- ☆25May 25, 2024Updated 2 years ago
- ☆36Jun 4, 2025Updated last year
- ☆141Oct 8, 2026Updated 2 weeks ago
- Framework for generating behavioral evaluations of frontier AI models.☆38Oct 14, 2026Updated last week
- Extract residual-stream activations and apply steering vectors (including activation oracles) to any vLLM model during inference.☆137Oct 13, 2026Updated last week
- ☆65Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Run Inspect AI evals in the cloud☆95Updated this week
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆952Jun 2, 2026Updated 4 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,988Updated this week
- Inspect AI interface to Harbor tasks☆26Updated this week
- AI Control for Claude Code in the real world☆34Sep 27, 2026Updated 3 weeks ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆1,125Updated this week
- ☆662Jun 19, 2025Updated last year
- ☆26Jun 22, 2025Updated last year
- ☆136Jul 28, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆344Updated this week
- A suite of interpretability tasks to evaluate agents using Scribe for notebook access☆18Oct 2, 2025Updated last year
- A curated reading list for researchers in the Philosophy of Interpretability☆21Aug 17, 2025Updated last year
- ☆24Jul 28, 2026Updated 2 months ago
- Code used for "Training Agents to Self-Report Misbehavior"☆20Feb 27, 2026Updated 7 months ago
- ☆171Oct 16, 2025Updated last year
- Transcript analysis for long-horizon agent evaluations☆62Updated this week