anthropic-experimental / automated-auditingLinks
Prompts used in the Automated Auditing Blog Post
☆103Updated 2 months ago
Alternatives and similar repositories for automated-auditing
Users that are interested in automated-auditing are comparing it to the libraries listed below
Sorting:
- ☆449Updated 3 months ago
- Inference-time scaling for LLMs-as-a-judge.☆300Updated last week
- Public repository containing METR's DVC pipeline for eval data analysis☆117Updated 6 months ago
- A framework for optimizing DSPy programs with RL☆191Updated this week
- An alignment auditing agent capable of quickly exploring alignment hypothesis☆364Updated this week
- Testing baseline LLMs performance across various models☆311Updated last week
- ⚖️ Awesome LLM Judges ⚖️☆130Updated 5 months ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆115Updated this week
- j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.☆98Updated 2 months ago
- Red-Teaming Language Models with DSPy☆216Updated 7 months ago
- Open source interpretability artefacts for R1.☆161Updated 5 months ago
- Training-Ready RL Environments + Evals☆116Updated last week
- A Tree Search Library with Flexible API for LLM Inference-Time Scaling☆475Updated 2 months ago
- OSS RL environment + evals toolkit☆186Updated this week
- ☆166Updated 9 months ago
- The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers☆97Updated this week
- ☆216Updated 7 months ago
- SoTA Approach for ARC-AGI 2☆97Updated 3 weeks ago
- Plotting (entropy, varentropy) for small LMs☆98Updated 4 months ago
- ☆135Updated 6 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆77Updated 6 months ago
- The State Of The Art, intelligence☆152Updated last month
- A better way of testing, inspecting, and analyzing AI Agent traces.☆40Updated last week
- Letting Claude Code develop his own MCP tools :)☆122Updated 7 months ago
- explore token trajectory trees on instruct and base models☆133Updated 4 months ago
- Sphynx Hallucination Induction☆53Updated 8 months ago
- Together Open Deep Research☆352Updated 5 months ago
- Collection of evals for Inspect AI☆241Updated last week
- METR Task Standard☆162Updated 8 months ago
- ☆225Updated 3 months ago