Alternatives and similar repositories for automated-auditing

Users that are interested in automated-auditing are comparing it to the libraries listed below

• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆124Updated 6 months ago
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆304Updated last month
• anthropic-experimental / agentic-misalignment
  ☆494Updated 4 months ago
• safety-research / petri
  An alignment auditing agent capable of quickly exploring alignment hypothesis
  ☆626Updated this week
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆235Updated 8 months ago
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆100Updated this week
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆98Updated 3 months ago
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆50Updated 6 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆163Updated 6 months ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆208Updated last week
• princeton-pli / hal-harness
  ☆172Updated last week
• ScalingIntelligence / codemonkeys
  ☆59Updated 9 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆132Updated 6 months ago
• alexzhang13 / rlm
  Super basic implementation (gist-like) of RLMs with REPL environments.
  ☆204Updated 2 weeks ago
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆132Updated last week
• emergent-misalignment / emergent-misalignment
  ☆222Updated 7 months ago
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆79Updated 7 months ago
• MinhxLe / subliminal-learning
  ☆98Updated 3 months ago
• SakanaAI / treequest
  A Tree Search Library with Flexible API for LLM Inference-Time Scaling
  ☆479Updated 2 weeks ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆118Updated last week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆109Updated 7 months ago
• epang080516 / arc_agi
  SoTA Approach for ARC-AGI 2
  ☆126Updated last month
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆319Updated 3 weeks ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆40Updated last week
• centerforaisafety / emergent-values
  Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"
  ☆76Updated 8 months ago
• SWE-agent / SWE-ReX
  Sandboxed code execution for AI agents, locally or on the cloud. Massively parallel, easy to extend. Powering SWE-agent and more.
  ☆349Updated this week
• Aider-AI / polyglot-benchmark
  Coding problems used in aider's polyglot benchmark
  ☆184Updated 10 months ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆24Updated this week
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆264Updated last week
• hud-evals / hud-python
  OSS RL environment + evals toolkit
  ☆192Updated last week