Collection of evals for Inspect AI
☆529Jun 10, 2026Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Inspect: A framework for large language model evaluations☆2,188Updated this week
- ☆49May 17, 2026Updated 3 weeks ago
- METR Task Standard☆181Feb 3, 2025Updated last year
- ☆34Jun 4, 2025Updated last year
- An Inspect extension for agentic cyber evaluations☆29May 28, 2026Updated 2 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆138May 18, 2026Updated 3 weeks ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆201Jun 9, 2026Updated last week
- [ICML 2025] UDora: A Unified Red Teaming Framework against LLM Agents☆37Jun 24, 2025Updated 11 months ago
- ☆124Jan 19, 2026Updated 4 months ago
- ☆73Jun 5, 2026Updated last week
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 4 years ago
- ☆25May 25, 2024Updated 2 years ago
- ☆300Updated this week
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆30Aug 14, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆140Oct 16, 2025Updated 7 months ago
- A python sdk for LLM finetuning and inference on runpod infrastructure☆30May 12, 2026Updated last month
- ☆1,131Updated this week
- (ICLR 2025) AgentRefine: Enhancing Agent Generalization through Refinement Tuning☆20Nov 22, 2025Updated 6 months ago
- ☆108Jun 6, 2026Updated last week
- Applying SAEs for fine-grained control☆27Dec 15, 2024Updated last year
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆1,233Updated this week
- [LREC-Coling 2024] PECC: Problem Extraction and Coding Challenges☆14May 30, 2024Updated 2 years ago
- Official implementation for the paper, StackEval: Benchmarking LLMs in Coding Assistance, https://arxiv.org/abs/2412.05288☆20Oct 30, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆955Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆261Feb 27, 2026Updated 3 months ago
- Efficient LLM inference on Slurm clusters.☆102Updated this week
- Work in progress! I don't recommend looking at the code right now.☆24May 29, 2026Updated 2 weeks ago
- Prompt Generator model for Stable Diffusion Models☆12Jun 20, 2023Updated 2 years ago
- Training Sparse Autoencoders on Language Models☆1,419Jun 9, 2026Updated last week
- Open source replication of Anthropic's Crosscoders for Model Diffing☆67Oct 27, 2024Updated last year
- ☆143Feb 10, 2026Updated 4 months ago
- Inference API for many LLMs and other useful tools for empirical research☆126May 29, 2026Updated 2 weeks ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆83Mar 1, 2025Updated last year
- Playing around with various jailbreaking techniques ahead of the Gray Swan AI Ultimate Jailbreaking Competition☆18Oct 6, 2024Updated last year
- A python framework to streamline your ARC challenge solutions. From graphical displays to optimized Kaggle submissions☆13Oct 17, 2024Updated last year
- ☆54May 9, 2025Updated last year
- [ICLR 2025] Code implementation of R^2-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning☆23Jul 8, 2024Updated last year
- Repo for the paper on Escalation Risks of AI systems☆44Apr 12, 2024Updated 2 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year