Collection of evals for Inspect AI
☆393Mar 4, 2026Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below
Sorting:
- Inspect: A framework for large language model evaluations☆1,800Updated this week
- METR Task Standard☆177Feb 3, 2025Updated last year
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆158Feb 27, 2026Updated last week
- An Inspect extension for agentic cyber evaluations☆22Feb 24, 2026Updated last week
- ☆33Jun 4, 2025Updated 9 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆134Feb 15, 2026Updated 2 weeks ago
- ☆20May 25, 2024Updated last year
- ☆237Updated this week
- ☆133Oct 16, 2025Updated 4 months ago
- ☆65Feb 20, 2026Updated 2 weeks ago
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆15Sep 4, 2024Updated last year
- ☆120Jan 19, 2026Updated last month
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 3 years ago
- [ICML 2025] UDora: A Unified Red Teaming Framework against LLM Agents☆31Jun 24, 2025Updated 8 months ago
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆20Oct 30, 2024Updated last year
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆15Aug 7, 2025Updated 6 months ago
- ☆203Dec 13, 2025Updated 2 months ago
- ☆25Nov 4, 2024Updated last year
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆116Jun 13, 2024Updated last year
- AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each…☆92Feb 21, 2026Updated last week
- ☆960Updated this week
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆20Oct 18, 2024Updated last year
- ☆45Aug 13, 2025Updated 6 months ago
- ☆41Jul 6, 2025Updated 8 months ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆836Updated this week
- ☆14Jul 18, 2025Updated 7 months ago
- Code for Fast Propagation is Better: Accelerating Single-Step Adversarial Training via Sampling Subnetworks (TIFS2024)☆13Mar 29, 2024Updated last year
- ☆12May 2, 2023Updated 2 years ago
- ☆20Feb 3, 2025Updated last year
- Prompt Generator model for Stable Diffusion Models☆11Jun 20, 2023Updated 2 years ago
- Code repo for the model organisms and convergent directions of EM papers.☆53Sep 22, 2025Updated 5 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆454Feb 3, 2026Updated last month
- The application is a end-user training and evaluation system for standard knowledge graph embedding models. It was developed to optimise …☆18May 30, 2025Updated 9 months ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Feb 13, 2023Updated 3 years ago
- ☆11Nov 11, 2022Updated 3 years ago
- A repository that holds templates, examples, and tests to help external parties submit tasks to AISI that conform with the Autonomous Sys…☆11Jan 16, 2026Updated last month
- Inverse Scaling in Test-Time Compute☆25Dec 3, 2025Updated 3 months ago
- [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …☆35Oct 23, 2024Updated last year
- Code for Voice Jailbreak Attacks Against GPT-4o.☆36May 31, 2024Updated last year