Collection of evals for Inspect AI
☆437Apr 14, 2026Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect: A framework for large language model evaluations☆1,890Apr 8, 2026Updated last week
- ☆48Mar 19, 2026Updated 3 weeks ago
- METR Task Standard☆179Feb 3, 2025Updated last year
- A Kubernetes sandbox environment for use with inspect_ai☆29Apr 9, 2026Updated last week
- An Inspect extension for agentic cyber evaluations☆25Apr 9, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆33Jun 4, 2025Updated 10 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆135Feb 15, 2026Updated 2 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆177Updated this week
- ☆119Jan 19, 2026Updated 2 months ago
- ☆69Apr 8, 2026Updated last week
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 4 years ago
- ☆23May 25, 2024Updated last year
- ☆256Apr 9, 2026Updated last week
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆30Aug 14, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆135Oct 16, 2025Updated 6 months ago
- A python sdk for LLM finetuning and inference on runpod infrastructure☆25Updated this week
- ☆41Jul 6, 2025Updated 9 months ago
- (ICLR 2025) AgentRefine: Enhancing Agent Generalization through Refinement Tuning☆18Nov 22, 2025Updated 4 months ago
- ☆1,031Mar 29, 2026Updated 2 weeks ago
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated last year
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆20Oct 30, 2024Updated last year
- Work in progress! I don't recommend looking at the code right now.☆24Apr 1, 2026Updated 2 weeks ago
- ☆43May 9, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆117Feb 10, 2026Updated 2 months ago
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆79Mar 1, 2025Updated last year
- Code implementation of R^2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning☆22Jul 8, 2024Updated last year
- Repo for the paper on Escalation Risks of AI systems☆44Apr 12, 2024Updated 2 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆22Oct 18, 2024Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆527Mar 30, 2026Updated 2 weeks ago
- Code repository for the paper "Heuristic Induced Multimodal Risk Distribution Jailbreak Attack for Multimodal Large Language Models"☆16Aug 7, 2025Updated 8 months ago
- MLBench Framework Core Python Library☆17Mar 1, 2023Updated 3 years ago
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆115Jun 13, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A fast + lightweight implementation of the GCG algorithm in PyTorch☆324May 13, 2025Updated 11 months ago
- A repository that holds templates, examples, and tests to help external parties submit tasks to AISI that conform with the Autonomous Sys…☆11Jan 16, 2026Updated 3 months ago
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆982Mar 12, 2026Updated last month
- ☆13Jul 12, 2024Updated last year
- ☆89Updated this week
- ☆25Nov 4, 2024Updated last year
- ☆25May 28, 2025Updated 10 months ago