METR / vivariaLinks
Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
☆116Updated this week
Alternatives and similar repositories for vivaria
Users that are interested in vivaria are comparing it to the libraries listed below
Sorting:
- METR Task Standard☆163Updated 8 months ago
- ☆28Updated 4 months ago
- ☆104Updated last week
- Sphynx Hallucination Induction☆53Updated 8 months ago
- ☆60Updated last month
- ☆113Updated last week
- Collection of evals for Inspect AI☆264Updated this week
- A toolkit for describing model features and intervening on those features to steer behavior.☆207Updated 11 months ago
- Open source interpretability artefacts for R1.☆163Updated 6 months ago
- Inference-time scaling for LLMs-as-a-judge.☆303Updated 3 weeks ago
- ☆142Updated last month
- ☆220Updated 7 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆104Updated this week
- ☆167Updated last week
- Training-Ready RL Environments + Evals☆132Updated this week
- Red-Teaming Language Models with DSPy☆221Updated 8 months ago
- Extract full next-token probabilities via language model APIs☆247Updated last year
- An attribution library for LLMs☆43Updated last year
- ☆35Updated last month
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆119Updated last year
- ☆26Updated last year
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆97Updated 6 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆187Updated 7 months ago
- ☆45Updated 3 weeks ago
- ☆135Updated 7 months ago
- ⚖️ Awesome LLM Judges ⚖️☆132Updated 5 months ago
- Draw more samples☆194Updated last year
- A better way of testing, inspecting, and analyzing AI Agent traces.☆40Updated this week
- Commit0: Library Generation from Scratch☆169Updated 5 months ago
- ☆304Updated last year