Alternatives and similar repositories for safety-eval

Users that are interested in safety-eval are comparing it to the libraries listed below

• allenai / wildguard
  Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
  ☆82Updated 6 months ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆98Updated 4 months ago
• ScalerLab / JudgeBench
  ☆86Updated 7 months ago
• milesaturpin / cot-unfaithfulness
  ☆44Updated last year
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆95Updated 3 weeks ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆214Updated 9 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆69Updated last year
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆100Updated last year
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆37Updated 7 months ago
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆76Updated last month
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆79Updated 8 months ago
• abertsch72 / long-context-icl
  Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"
  ☆37Updated 10 months ago
• rishub-tamirisa / tamper-resistance
  [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"
  ☆58Updated 2 weeks ago
• neulab / data-agora
  [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"
  ☆33Updated 6 months ago
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆78Updated last year
• mlcommons / modelbench
  Run safety benchmarks against AI models and view detailed reports showing how well they performed.
  ☆94Updated last week
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆34Updated 11 months ago
• allenai / wildteaming
  ☆29Updated 10 months ago
• amazon-science / controlling-llm-memorization
  ☆36Updated 2 years ago
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆28Updated last year
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆145Updated last year
• boyiwei / CoTaEval
  [NeurIPS 2024 D&B] Evaluating Copyright Takedown Methods for Language Models
  ☆17Updated 11 months ago
• yihuaihong / ConceptVectors
  ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"
  ☆35Updated 4 months ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 9 months ago
• lyy1994 / awesome-data-contamination
  The Paper List on Data Contamination for Large Language Models Evaluation.
  ☆95Updated 2 months ago
• technion-cs-nlp / LLMsKnow
  ☆73Updated 5 months ago
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆23Updated 11 months ago
• Jiaxin-Pei / Prompting-with-Social-Roles
  ☆37Updated 8 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆109Updated last year