Collection of evals for Inspect AI
☆478May 4, 2026Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect: A framework for large language model evaluations☆2,000Updated this week
- ☆48Mar 19, 2026Updated last month
- METR Task Standard☆179Feb 3, 2025Updated last year
- A Kubernetes sandbox environment for use with inspect_ai☆29Apr 15, 2026Updated 3 weeks ago
- An Inspect extension for agentic cyber evaluations☆27Apr 23, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆33Jun 4, 2025Updated 11 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆136Feb 15, 2026Updated 2 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆189Apr 27, 2026Updated last week
- [ICML 2025] UDora: A Unified Red Teaming Framework against LLM Agents☆33Jun 24, 2025Updated 10 months ago
- ☆121Jan 19, 2026Updated 3 months ago
- ☆69Apr 21, 2026Updated 2 weeks ago
- ☆23May 25, 2024Updated last year
- ☆273Updated this week
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆30Aug 14, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆136Oct 16, 2025Updated 6 months ago
- A python sdk for LLM finetuning and inference on runpod infrastructure☆30Apr 23, 2026Updated last week
- ☆41Jul 6, 2025Updated 10 months ago
- ☆1,056Updated this week
- ☆94Updated this week
- Applying SAEs for fine-grained control☆26Dec 15, 2024Updated last year
- ☆237Apr 22, 2026Updated 2 weeks ago
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆256Feb 27, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Work in progress! I don't recommend looking at the code right now.☆23Apr 26, 2026Updated last week
- Prompt Generator model for Stable Diffusion Models☆12Jun 20, 2023Updated 2 years ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆917Updated this week
- ☆43May 9, 2025Updated 11 months ago
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆1,004Updated this week
- Open source replication of Anthropic's Crosscoders for Model Diffing☆65Oct 27, 2024Updated last year
- Subliminal learning in LLMs: language models can transmit hidden preferences through seemingly unrelated training data.☆22Nov 9, 2025Updated 5 months ago
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆80Mar 1, 2025Updated last year
- Training Sparse Autoencoders on Language Models☆1,361Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Code implementation of R^2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning☆22Jul 8, 2024Updated last year
- Repo for the paper on Escalation Risks of AI systems☆44Apr 12, 2024Updated 2 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆17Aug 7, 2025Updated 8 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆548Mar 30, 2026Updated last month
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆115Jun 13, 2024Updated last year
- The official repository for guided jailbreak benchmark☆29Jul 28, 2025Updated 9 months ago