Alternatives and similar repositories for automated-auditing

Users that are interested in automated-auditing are comparing it to the libraries listed below

• safety-research / petri
  An alignment auditing agent capable of quickly exploring alignment hypothesis
  ☆776Updated 2 weeks ago
• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆168Updated 8 months ago
• alexzhang13 / rlm-minimal
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆290Updated 2 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆320Updated last month
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆128Updated last month
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆248Updated 10 months ago
• anthropic-experimental / agentic-misalignment
  ☆542Updated 6 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆303Updated this week
• PrimeIntellect-ai / prime
  Official CLI and Python SDK for Prime Intellect - access GPU compute, remote sandboxes, RL environments, and distributed training infrast…
  ☆126Updated this week
• safety-research / false-facts
  ☆29Updated 5 months ago
• PrimeIntellect-ai / prime-environments
  Curated collection of community environments
  ☆196Updated last week
• princeton-pli / hal-harness
  ☆208Updated this week
• ScalingIntelligence / codemonkeys
  ☆59Updated 11 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆146Updated 8 months ago
• laude-institute / harbor
  Harbor is a framework for running agent evaluations and creating and using RL environments.
  ☆241Updated this week
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆99Updated 5 months ago
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆52Updated 8 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆165Updated 8 months ago
• MinhxLe / subliminal-learning
  ☆104Updated 5 months ago
• metauto-ai / HGM
  🧬 The Huxley-Gödel Machine
  ☆317Updated last month
• PrimeIntellect-ai / genesys
  ☆136Updated 9 months ago
• ScalingIntelligence / Archon
  Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.
  ☆190Updated 9 months ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆320Updated last week
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆84Updated 9 months ago
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆287Updated last week
• allenai / agent-baselines
  ☆102Updated 3 weeks ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated 2 months ago
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆199Updated last year
• SakanaAI / treequest
  A Tree Search Library with Flexible API for LLM Inference-Time Scaling
  ☆509Updated 3 weeks ago
• HyperPotatoNeo / RSA
  ☆80Updated 3 months ago