Alternatives and similar repositories for automated-auditing

Users that are interested in automated-auditing are comparing it to the libraries listed below

• METR / eval-analysis-public
  Public repository containing METR's DVC pipeline for eval data analysis
  ☆86Updated 4 months ago
• anthropic-experimental / agentic-misalignment
  ☆377Updated last month
• haizelabs / verdict
  Inference-time scaling for LLMs-as-a-judge.
  ☆267Updated 3 weeks ago
• Ziems / arbor
  A framework for optimizing DSPy programs with RL
  ☆96Updated this week
• SakanaAI / treequest
  A Tree Search Library with Flexible API for LLM Inference-Time Scaling
  ☆433Updated last week
• microsoft / debug-gym
  A Text-Based Environment for Interactive Debugging
  ☆250Updated this week
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆47Updated 4 months ago
• huggingface / gpt-oss-recipes
  Collection of scripts and notebooks for OpenAI's latest GPT OSS models
  ☆222Updated this week
• arcprize / arc-agi-benchmarking
  Testing baseline LLMs performance across various models
  ☆293Updated 2 weeks ago
• haizelabs / j1-micro
  j1-micro (1.7B) & j1-nano (600M) are absurdly tiny but mighty reward models.
  ☆95Updated 2 weeks ago
• invariantlabs-ai / explorer
  A better way of testing, inspecting, and analyzing AI Agent traces.
  ☆39Updated last month
• Not-Diamond / RoRF
  Routing on Random Forest (RoRF)
  ☆187Updated 10 months ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆103Updated last week
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆23Updated 4 months ago
• facebookresearch / matrix
  Matrix (Multi-Agent daTa geneRation Infra and eXperimentation framework) is a versatile engine for multi-agent conversational data genera…
  ☆81Updated last week
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆103Updated 5 months ago
• LLMSELECTOR / LLMSELECTOR
  ☆73Updated 5 months ago
• simple-bench / SimpleBench
  ☆146Updated 7 months ago
• haizelabs / Awesome-LLM-Judges
  ⚖️ Awesome LLM Judges ⚖️
  ☆108Updated 3 months ago
• PrimeIntellect-ai / genesys
  ☆130Updated 4 months ago
• openai / build-hours
  Build hours code to share.
  ☆427Updated last week
• Royaltyprogram / Crux
  The State Of The Art, intelligence
  ☆148Updated this week
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆72Updated 4 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆203Updated 5 months ago
• Arize-ai / prompt-learning
  ☆58Updated this week
• allenai / autods
  ☆72Updated this week
• emergent-misalignment / emergent-misalignment
  ☆182Updated 5 months ago
• ServiceNow / TapeAgents
  TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle
  ☆289Updated last week
• METR / RE-Bench
  ☆95Updated 3 months ago
• Columbia-NLP-Lab / PAPILLON
  Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles
  ☆53Updated 3 months ago