METR Task Standard
☆199Oct 7, 2026Updated last month
Alternatives and similar repositories for task-standard
Users that are interested in task-standard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆138Oct 20, 2026Updated 3 weeks ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆145Oct 7, 2026Updated last month
- ☆37Jun 4, 2025Updated last year
- ☆171Oct 20, 2026Updated 3 weeks ago
- Inspect: A framework for large language model evaluations☆3,277Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Collection of evals for Inspect AI☆750Updated this week
- ☆34Nov 11, 2025Updated last year
- ☆12Nov 11, 2025Updated last year
- Inference API for many LLMs and other useful tools for empirical research☆143May 29, 2026Updated 5 months ago
- Benchmarking Dark Patterns in LLMs (ICLR 2025)☆20Mar 29, 2025Updated last year
- ☆13Jan 14, 2026Updated 10 months ago
- (Model-written) LLM evals library☆19Dec 13, 2024Updated last year
- ☆13Dec 6, 2025Updated 11 months ago
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆23Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated 2 years ago
- Einsum with einops style variable names☆19May 16, 2024Updated 2 years ago
- ☆20Nov 11, 2026Updated last week
- ☆1,420Updated this week
- we got you bro☆39Jul 29, 2024Updated 2 years ago
- Situational Awareness Dataset☆56Dec 14, 2024Updated last year
- A python sdk for LLM finetuning and inference on runpod infrastructure☆31Updated this week
- 🔥 A repository for collecting cyberdefense thoughts, books, and documents about AI cyberdefense☆13Jul 2, 2023Updated 3 years ago
- ☆450Jul 2, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆15Jul 12, 2024Updated 2 years ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆249Aug 11, 2025Updated last year
- A library for mechanistic interpretability of GPT-style language models☆4,083Updated this week
- A Kubernetes sandbox environment for use with inspect_ai☆42Oct 30, 2026Updated 3 weeks ago
- An Inspect extension for agentic cyber evaluations☆47Updated this week
- Benchmarks for the Evaluation of LLM Supervision☆35Jan 19, 2026Updated 10 months ago
- Machine Learning for Alignment Bootcamp☆88Oct 6, 2026Updated last month
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆270Updated this week
- Mechanistic Interpretability on Reasoning using Gemma-Scope for BlueDot Impact Course.☆13Sep 27, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 📚📚📚📚📚📚📚📚📚 Reading everything☆17Mar 11, 2026Updated 8 months ago
- 3cb: Catastrophic Cyber Capabilities Benchmarking of Large Language Models☆17Oct 30, 2024Updated 2 years ago
- ☆77Jun 16, 2026Updated 5 months ago
- Language model alignment-focused deep learning curriculum☆1,733Aug 19, 2024Updated 2 years ago
- ☆67Jul 4, 2025Updated last year
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Aug 21, 2023Updated 3 years ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆1,151Updated this week
Are these results useful?