UKGovernmentBEIS / inspect_evalsView external linksLinks
Collection of evals for Inspect AI
☆361Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below
Sorting:
- Inspect: A framework for large language model evaluations☆1,727Feb 7, 2026Updated last week
- METR Task Standard☆173Feb 3, 2025Updated last year
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆153Feb 4, 2026Updated last week
- An Inspect extension for agentic cyber evaluations☆21Feb 6, 2026Updated last week
- ☆33Jun 4, 2025Updated 8 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆134Updated this week
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆28Aug 14, 2024Updated last year
- ☆223Feb 6, 2026Updated last week
- ☆133Oct 16, 2025Updated 3 months ago
- ☆65Updated this week
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆15Sep 4, 2024Updated last year
- ☆118Jan 19, 2026Updated 3 weeks ago
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 3 years ago
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆20Oct 30, 2024Updated last year
- Build an AI bot in Discord to serve user's personalized reports on what's up in tech☆28Sep 14, 2025Updated 4 months ago
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆15Aug 7, 2025Updated 6 months ago
- The official repository for guided jailbreak benchmark☆28Jul 28, 2025Updated 6 months ago
- ☆25Nov 4, 2024Updated last year
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆116Jun 13, 2024Updated last year
- ☆929Feb 4, 2026Updated last week
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆21Oct 18, 2024Updated last year
- ☆44Aug 13, 2025Updated 6 months ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆811Updated this week
- ☆40Jul 6, 2025Updated 7 months ago
- Prompt Generator model for Stable Diffusion Models☆11Jun 20, 2023Updated 2 years ago
- ☆12May 2, 2023Updated 2 years ago
- Produce probabilities for economy-based environments.☆11Sep 10, 2022Updated 3 years ago
- ☆20Feb 3, 2025Updated last year
- Code for Fast Propagation is Better: Accelerating Single-Step Adversarial Training via Sampling Subnetworks (TIFS2024)☆13Mar 29, 2024Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆431Feb 3, 2026Updated last week
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Feb 13, 2023Updated 3 years ago
- ☆11Nov 11, 2022Updated 3 years ago
- Inverse Scaling in Test-Time Compute☆25Dec 3, 2025Updated 2 months ago
- ☆12Jul 12, 2024Updated last year
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated last year
- The application is a end-user training and evaluation system for standard knowledge graph embedding models. It was developed to optimise …☆18May 30, 2025Updated 8 months ago
- A repository that holds templates, examples, and tests to help external parties submit tasks to AISI that conform with the Autonomous Sys…☆11Jan 16, 2026Updated 3 weeks ago
- [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …☆34Oct 23, 2024Updated last year
- Code for Voice Jailbreak Attacks Against GPT-4o.☆36May 31, 2024Updated last year