anthropic-experimental / automated-auditingLinks
Prompts used in the Automated Auditing Blog Post
☆96Updated last month
Alternatives and similar repositories for automated-auditing
Users that are interested in automated-auditing are comparing it to the libraries listed below
Sorting:
- ☆417Updated 3 months ago
- Inference-time scaling for LLMs-as-a-judge.☆297Updated 2 weeks ago
- ⚖️ Awesome LLM Judges ⚖️☆127Updated 4 months ago
- Public repository containing METR's DVC pipeline for eval data analysis☆108Updated 5 months ago
- Testing baseline LLMs performance across various models☆307Updated last month
- A framework for optimizing DSPy programs with RL☆177Updated this week
- Open source interpretability artefacts for R1.☆158Updated 4 months ago
- ☆223Updated 2 months ago
- Red-Teaming Language Models with DSPy☆213Updated 7 months ago
- Collection of scripts and notebooks for OpenAI's latest GPT OSS models☆437Updated 3 weeks ago
- A Tree Search Library with Flexible API for LLM Inference-Time Scaling☆458Updated last month
- ☆133Updated 6 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆111Updated this week
- ☆165Updated 8 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆77Updated 6 months ago
- A Text-Based Environment for Interactive Debugging☆265Updated this week
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆24Updated last week
- Train your own SOTA deductive reasoning model☆106Updated 6 months ago
- OSS RL environment + evals toolkit☆176Updated this week
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆182Updated 6 months ago
- Open Source Replication of Anthropic's Alignment Faking Paper☆50Updated 5 months ago
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆97Updated 2 months ago
- ☆129Updated last week
- Letting Claude Code develop his own MCP tools :)☆121Updated 6 months ago
- ☆55Updated 7 months ago
- ☆76Updated 6 months ago
- Training-Ready RL Environments + Evals☆90Updated last week
- MCP-based Agent Deep Evaluation System☆129Updated this week
- A better way of testing, inspecting, and analyzing AI Agent traces.☆40Updated this week
- The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers☆84Updated this week