Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
☆142May 18, 2026Updated 4 months ago
Alternatives and similar repositories for vivaria
Users that are interested in vivaria are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆36Jun 4, 2025Updated last year
- ☆131Jul 28, 2026Updated last month
- ☆164Oct 16, 2025Updated 11 months ago
- METR Task Standard☆197Feb 3, 2025Updated last year
- Experimental LLM interface exploring new ways to use AI to improve human thinking☆21Apr 13, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆24Jul 28, 2026Updated last month
- Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity: https://metr.org/blog/2025-07-10-early-2025-ai-e…☆17Feb 23, 2026Updated 7 months ago
- ☆33Nov 11, 2025Updated 10 months ago
- ☆138Updated this week
- Running UK AISI's Inspect in the Cloud☆25May 6, 2026Updated 4 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆331Mar 6, 2026Updated 6 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆241Aug 24, 2026Updated last month
- A text-based game where language models learn to lie and to detect lies.☆12Oct 4, 2023Updated 2 years ago
- Inspect: A framework for large language model evaluations☆2,850Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Collection of evals for Inspect AI☆680Updated this week
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆225Updated this week
- ☆75Jun 16, 2026Updated 3 months ago
- ☆57Sep 9, 2026Updated 2 weeks ago
- Inference API for many LLMs and other useful tools for empirical research☆137May 29, 2026Updated 3 months ago
- Easily deploy my zsh and tmux configuration on new machines. Includes local and remote aliases to improve workflow.☆16Apr 23, 2026Updated 5 months ago
- Effective Altruism data visualiser. Deployed at https://effectivealtruismdata.com☆16Oct 16, 2022Updated 3 years ago
- Tools for evolutionary forecasting☆14Jun 19, 2026Updated 3 months ago
- Machine Learning for Alignment Bootcamp☆28Mar 7, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆34May 23, 2024Updated 2 years ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆18Sep 15, 2023Updated 3 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆15Feb 13, 2023Updated 3 years ago
- ☆13May 7, 2023Updated 3 years ago
- 🔮📈 Making, tracking and improving personal forecasts (e.g. the weather tomorrow or your salary in 2 years).☆24Jan 28, 2026Updated 7 months ago
- ☆31May 4, 2023Updated 3 years ago
- ☆15Jul 12, 2024Updated 2 years ago
- ☆26Jun 22, 2025Updated last year
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆119Jun 13, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- harvard-cs-2881-classroom-hw0-c2881-hw0 created by GitHub Classroom☆18Jul 26, 2025Updated last year
- ☆36Mar 27, 2025Updated last year
- ☆33Jul 1, 2026Updated 2 months ago
- Run Inspect AI evals in the cloud☆79Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆275Feb 27, 2026Updated 6 months ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆366Apr 30, 2026Updated 4 months ago