Collection of evals for Inspect AI
☆415Mar 24, 2026Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect: A framework for large language model evaluations☆1,851Updated this week
- ☆48Mar 19, 2026Updated last week
- METR Task Standard☆178Feb 3, 2025Updated last year
- A Kubernetes sandbox environment for use with inspect_ai☆28Mar 19, 2026Updated last week
- An Inspect extension for agentic cyber evaluations☆24Feb 24, 2026Updated last month
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆33Jun 4, 2025Updated 9 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆135Feb 15, 2026Updated last month
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆164Mar 19, 2026Updated last week
- [ICML 2025] UDora: A Unified Red Teaming Framework against LLM Agents☆33Jun 24, 2025Updated 9 months ago
- ☆121Jan 19, 2026Updated 2 months ago
- ☆66Feb 20, 2026Updated last month
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 3 years ago
- ☆22May 25, 2024Updated last year
- ☆247Mar 19, 2026Updated last week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆29Aug 14, 2024Updated last year
- ☆134Oct 16, 2025Updated 5 months ago
- ☆14Jul 18, 2025Updated 8 months ago
- ☆41Jul 6, 2025Updated 8 months ago
- (ICLR 2025) AgentRefine: Enhancing Agent Generalization through Refinement Tuning☆19Nov 22, 2025Updated 4 months ago
- ☆1,000Mar 14, 2026Updated last week
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated last year
- Efficient LLM inference on Slurm clusters.☆95Updated this week
- Prompt Generator model for Stable Diffusion Models☆12Jun 20, 2023Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Work in progress! I don't recommend looking at the code right now.☆24Dec 3, 2025Updated 3 months ago
- ☆41May 9, 2025Updated 10 months ago
- ☆114Feb 10, 2026Updated last month
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆15Aug 7, 2025Updated 7 months ago
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆77Mar 1, 2025Updated last year
- A python framework to streamline your ARC challenge solutions. From graphical displays to optimized Kaggle submissions☆13Oct 17, 2024Updated last year
- Code implementation of R^2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning☆22Jul 8, 2024Updated last year
- Repo for the paper on Escalation Risks of AI systems☆44Apr 12, 2024Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆499Mar 12, 2026Updated 2 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- MLBench Framework Core Python Library☆18Mar 1, 2023Updated 3 years ago
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆115Jun 13, 2024Updated last year
- The official repository for guided jailbreak benchmark☆29Jul 28, 2025Updated 7 months ago
- A fast + lightweight implementation of the GCG algorithm in PyTorch☆322May 13, 2025Updated 10 months ago
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆956Mar 12, 2026Updated 2 weeks ago
- Code for Voice Jailbreak Attacks Against GPT-4o.☆37May 31, 2024Updated last year
- A repository that holds templates, examples, and tests to help external parties submit tasks to AISI that conform with the Autonomous Sys…☆11Jan 16, 2026Updated 2 months ago