Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
☆144Oct 7, 2026Updated 3 weeks ago
Alternatives and similar repositories for vivaria
Users that are interested in vivaria are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆36Jun 4, 2025Updated last year
- ☆137Oct 20, 2026Updated 2 weeks ago
- METR Task Standard☆198Oct 7, 2026Updated 3 weeks ago
- ☆171Oct 20, 2026Updated 2 weeks ago
- Experimental LLM interface exploring new ways to use AI to improve human thinking☆21Apr 13, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆24Oct 20, 2026Updated 2 weeks ago
- Public repository containing METR's DVC pipeline for eval data analysis☆343Mar 6, 2026Updated 7 months ago
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity: https://metr.org/blog/2025-07-10-early-2025-ai-e…☆17Feb 23, 2026Updated 8 months ago
- Running UK AISI's Inspect in the Cloud☆25May 6, 2026Updated 5 months ago
- ☆13Jan 14, 2026Updated 9 months ago
- ☆17Jun 17, 2025Updated last year
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆260Oct 26, 2026Updated last week
- Run Inspect AI evals in the cloud☆102Updated this week
- Collection of evals for Inspect AI☆732Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Data visualization for Inspect AI large language model evalutions.☆24Updated this week
- ☆76Jun 16, 2026Updated 4 months ago
- ☆33Nov 11, 2025Updated 11 months ago
- ☆17Oct 9, 2026Updated 3 weeks ago
- ☆21Feb 17, 2023Updated 3 years ago
- Inspect: A framework for large language model evaluations☆3,149Updated this week
- ☆25May 25, 2024Updated 2 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆226Oct 26, 2026Updated last week
- ☆13May 7, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆143Oct 24, 2026Updated last week
- Inference API for many LLMs and other useful tools for empirical research☆142May 29, 2026Updated 5 months ago
- ☆19Mar 10, 2026Updated 7 months ago
- Machine Learning for Alignment Bootcamp☆28Mar 7, 2024Updated 2 years ago
- A text-based game where language models learn to lie and to detect lies.☆12Oct 4, 2023Updated 3 years ago
- Software Engineering Agents for Inspect AI☆41Updated this week
- Inspect: A framework for large language model evaluations☆11Updated this week
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆15Feb 13, 2023Updated 3 years ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆270Mar 16, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆34May 23, 2024Updated 2 years ago
- Incentivizing externlization via early exiting☆41Feb 6, 2026Updated 8 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆277Feb 27, 2026Updated 8 months ago
- ☆59Oct 22, 2026Updated last week
- Mamba support for transformer lens☆20Sep 17, 2024Updated 2 years ago
- Sparse Autoencoder Training Library☆59May 1, 2025Updated last year
- ☆26Jun 22, 2025Updated last year