mlcommons / modelbenchLinks
Run safety benchmarks against AI models and view detailed reports showing how well they performed.
☆117Updated last week
Alternatives and similar repositories for modelbench
Users that are interested in modelbench are comparing it to the libraries listed below
Sorting:
- A simple evaluation of generative language models and safety classifiers.☆85Updated last month
- ☆154Updated 3 years ago
- Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs☆106Updated last year
- Improving Alignment and Robustness with Circuit Breakers☆258Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆127Updated 11 months ago
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆158Updated 8 months ago
- A Comprehensive Assessment of Trustworthiness in GPT Models☆311Updated last year
- Evaluating LLMs with fewer examples☆169Updated last year
- The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"☆107Updated 2 years ago
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆54Updated last year
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆70Updated last year
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆102Updated 2 years ago
- ☆228Updated 4 years ago
- ☆60Updated 2 years ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆246Updated last year
- ☆107Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆315Updated last year
- Collection of evals for Inspect AI☆357Updated this week
- WorkBench: a Benchmark Dataset for Agents in a Realistic Workplace Setting.☆62Updated last month
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆338Updated last year
- Repository for the Bias Benchmark for QA dataset.☆136Updated 2 years ago
- ☆117Updated last year
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆42Updated last year
- [ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets☆218Updated 2 years ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆124Updated last year
- Code for the paper "Fishing for Magikarp"☆179Updated 8 months ago
- ☆18Updated last year
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆108Updated last year
- ☆39Updated last year
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆127Updated last year