METR Task Standard
☆197Feb 3, 2025Updated last year
Alternatives and similar repositories for task-standard
Users that are interested in task-standard are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆130Jul 28, 2026Updated last month
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆142May 18, 2026Updated 4 months ago
- ☆35Jun 4, 2025Updated last year
- ☆163Oct 16, 2025Updated 11 months ago
- Inspect: A framework for large language model evaluations☆2,808Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Collection of evals for Inspect AI☆675Updated this week
- (Model-written) LLM evals library☆19Dec 13, 2024Updated last year
- ☆33Nov 11, 2025Updated 10 months ago
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated 2 years ago
- we got you bro☆39Jul 29, 2024Updated 2 years ago
- 🔥 A repository for collecting cyberdefense thoughts, books, and documents about AI cyberdefense☆13Jul 2, 2023Updated 3 years ago
- Automated Capability Discovery via Foundation Model Self-Exploration☆68Apr 16, 2026Updated 5 months ago
- Einsum with einops style variable names☆19May 16, 2024Updated 2 years ago
- Inference API for many LLMs and other useful tools for empirical research☆136May 29, 2026Updated 3 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆74Jun 16, 2026Updated 3 months ago
- ☆18Updated this week
- Software Engineering Agents for Inspect AI☆32Updated this week
- Situational Awareness Dataset☆55Dec 14, 2024Updated last year
- A library for mechanistic interpretability of GPT-style language models☆3,890Updated this week
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Aug 21, 2023Updated 3 years ago
- Benchmarks for the Evaluation of LLM Supervision☆35Jan 19, 2026Updated 8 months ago
- Inspect Flow is a workflow stack built on Inspect AI that enables research organisations to run AI evaluations at scale.☆22Updated this week
- Machine Learning for Alignment Bootcamp☆87Apr 27, 2022Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Benchmarking Dark Patterns in LLMs (ICLR 2025)☆18Mar 29, 2025Updated last year
- ☆41Dec 17, 2025Updated 9 months ago
- Using sparse coding to find distributed representations used by neural networks.☆313Nov 10, 2023Updated 2 years ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆248Aug 11, 2025Updated last year
- ☆428Jul 2, 2024Updated 2 years ago
- LLMs playing chess are sensitive to how the position came to be☆25Feb 14, 2024Updated 2 years ago
- ☆1,309Updated this week
- Harness used to benchmark aider against SWE Bench benchmarks☆92Jun 27, 2024Updated 2 years ago
- (WIP) A benchmark to see how well AI agents autonomously make money.☆15Jul 17, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆1,105Updated this week
- Data visualization for Inspect AI large language model evalutions.☆22Jul 15, 2026Updated 2 months ago
- Code for reproducing the results from the paper Avoiding Side Effects in Complex Environments☆12Jun 3, 2021Updated 5 years ago
- ☆19Feb 24, 2023Updated 3 years ago
- Animal Harm Assessment public repository☆12May 3, 2026Updated 4 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆226Dec 22, 2021Updated 4 years ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆239Aug 24, 2026Updated 3 weeks ago