Alternatives and similar repositories for llm-judge-bias-suite

Users that are interested in llm-judge-bias-suite are comparing it to the libraries listed below

• Jiaxin-Pei / Prompting-with-Social-Roles
  ☆42Updated last year
• google-research / camel-prompt-injection
  Code for the paper "Defeating Prompt Injections by Design"
  ☆187Updated 6 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆248Updated 10 months ago
• UKGovernmentBEIS / inspect_evals
  Collection of evals for Inspect AI
  ☆320Updated this week
• lisadunlap / VibeCheck
  Automated Qualitative Analysis of LLMs (ICLR 2025)
  ☆53Updated 5 months ago
• cohere-ai / magikarp
  Code for the paper "Fishing for Magikarp"
  ☆177Updated 7 months ago
• microsoft / TaskTracker
  TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…
  ☆78Updated 3 months ago
• google-deepmind / dangerous-capability-evaluations
  ☆63Updated 2 weeks ago
• UKGovernmentBEIS / hibayes
  ☆38Updated 2 weeks ago
• RapidResponseBench / rapidresponsebench
  ☆34Updated last year
• andyzorigin / cybench
  ☆182Updated 2 weeks ago
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆95Updated last year
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆112Updated last year
• emergent-misalignment / emergent-misalignment
  ☆236Updated 3 weeks ago
• Data-Provenance-Initiative / Data-Provenance-Collection
  ☆260Updated 9 months ago
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆46Updated last year
• Giskard-AI / awesome-ai-safety
  📚 A curated list of papers & technical articles on AI Quality & Safety
  ☆195Updated 8 months ago
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL Main '25)
  ☆26Updated 5 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆170Updated last year
• leondz / autoredteam
  autoredteam: code for training models that automatically red team other language models
  ☆15Updated 2 years ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 10 months ago
• haizelabs / get-haized
  A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.
  ☆100Updated 8 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆57Updated 9 months ago
• stanford-crfm / fmti
  The Foundation Model Transparency Index
  ☆84Updated 3 weeks ago
• centerforaisafety / wmdp
  WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…
  ☆157Updated 7 months ago
• METR / vivaria
  Vivaria is METR's tool for running evaluations and conducting agent elicitation research.
  ☆125Updated last month
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆92Updated last year
• TransluceAI / observatory
  A toolkit for describing model features and intervening on those features to steer behavior.
  ☆224Updated 2 weeks ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆33Updated last year
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 11 months ago