Run safety benchmarks against AI models and view detailed reports showing how well they performed.
☆138Oct 30, 2026Updated this week
Alternatives and similar repositories for modelbench
Users that are interested in modelbench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Make it easy to automatically and uniformly measure the behavior of many AI Systems.☆27Oct 2, 2024Updated 2 years ago
- Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting☆18Apr 15, 2025Updated last year
- AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies☆31Aug 14, 2024Updated 2 years ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆151Feb 24, 2025Updated last year
- A Comprehensive Assessment of Trustworthiness in GPT Models☆318Sep 16, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆160Aug 9, 2022Updated 4 years ago
- ☆24Apr 23, 2025Updated last year
- Code for our paper "Localizing Lying in Llama"☆15Apr 24, 2025Updated last year
- This repository contains the results and code for the MLPerf™ Training v4.0 benchmark.☆13Jun 11, 2024Updated 2 years ago
- This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.☆11Jul 24, 2025Updated last year
- The CSCS ReFrame test suite☆17Oct 25, 2026Updated last week
- This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.☆92May 19, 2024Updated 2 years ago
- This repository contains the results and code for the MLPerf™ Inference v4.0 benchmark.☆12Jul 24, 2025Updated last year
- This repository contains the results and code for the MLPerf™ Training v3.0 benchmark.☆12Aug 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Scientific articles using or citing Common Crawl data☆31Oct 26, 2026Updated last week
- ⚖️ Code for the paper "Ethical Adversaries: Towards Mitigating Unfairness with Adversarial Machine Learning".☆11Dec 8, 2022Updated 3 years ago
- Repository for PsychoEvals - a framework for LLM security, psychoanalysis, and moderation.☆18Apr 16, 2023Updated 3 years ago
- Working repo to support the Alliance's Open Trusted Data Initiative☆20Oct 19, 2026Updated 2 weeks ago
- [NeurIPS'24 LanGame workshop] On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability☆42Apr 10, 2026Updated 6 months ago
- The SAIL blog☆13Updated this week
- Megatron-LM setup in the smol-cluster☆12Aug 26, 2024Updated 2 years ago
- Foundation AI - Reinforcement Learning Library☆14Updated this week
- The official repository for the paper entitled "Time Travel in LLMs: Tracing Data Contamination in Large Language Models."☆15Jun 11, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Legacy CM repository with a collection of portable, reusable and cross-platform CM automations for MLOps and MLPerf to simplify the proce…☆20Mar 13, 2025Updated last year
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆91Mar 30, 2025Updated last year
- ☆12Jul 21, 2021Updated 5 years ago
- Running UK AISI's Inspect in the Cloud☆25May 6, 2026Updated 5 months ago
- A repository that holds templates, examples, and tests to help external parties submit tasks to AISI that conform with the Autonomous Sys…☆11Jan 16, 2026Updated 9 months ago
- Improving Alignment and Robustness with Circuit Breakers☆271Sep 24, 2024Updated 2 years ago
- ☆12Jul 11, 2026Updated 3 months ago
- Code for the paper Explanation-Guided Backdoor Poisoning Attacks Against Malware Classifiers☆60Apr 29, 2022Updated 4 years ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆361Feb 23, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A collection of public presentations from the Common Crawl Foundation☆13Feb 2, 2026Updated 9 months ago
- Generate shader code (for Shadertoy website) displaying path in provided SVG file.☆10Feb 24, 2026Updated 8 months ago
- Codebase for decoding compressed trust.☆27May 7, 2024Updated 2 years ago
- A dataset of alignment research and code to reproduce it☆80Jun 22, 2023Updated 3 years ago
- This repository contains data, code and models for contextual noncompliance.☆26Jul 18, 2024Updated 2 years ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆49Jan 21, 2025Updated last year
- Cross-platform Python client for the CodeReef.ai portal to manage portable workflows, reusable automation actions, software detection plu…☆11Mar 27, 2020Updated 6 years ago