Alternatives and similar repositories for CS-Eval

Users that are interested in CS-Eval are comparing it to the libraries listed below

• WhitzardIndex / WhitzardBench-2024A
  复旦白泽大模型安全基准测试集（2024年夏季版）
  ☆36Updated 9 months ago
• CSJianYang / SEevenLLM
  ☆34Updated 10 months ago
• XuanwuAI / SecEval
  ☆96Updated last year
• cybermetric / CyberMetric
  CyberMetric dataset
  ☆85Updated 4 months ago
• tuhh-softsec / LLMSecEval
  ☆39Updated 7 months ago
• LLM-DRA / DRA
  [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…
  ☆92Updated 7 months ago
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆62Updated 5 months ago
• CLUEbenchmark / SuperCLUE-Safety
  SC-Safety: 中文大模型多轮对抗安全基准
  ☆135Updated last year
• TrustAI-laboratory / Learn-Prompt-Hacking
  This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking cour…
  ☆69Updated last month
• OpenStellarTeam / ChineseSafetyQA
  ☆29Updated 4 months ago
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆79Updated 3 months ago
• tmylla / HackMentor
  The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".
  ☆119Updated 11 months ago
• agiresearch / ASB
  Agent Security Bench (ASB)
  ☆79Updated last week
• uiuc-kang-lab / cve-bench
  CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities
  ☆43Updated 2 weeks ago
• ai4cloudops / SecLLMHolmes
  SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…
  ☆57Updated last week
• STAIR-BUPT / JailBench
  JailBench：大型语言模型越狱攻击风险评测中文数据集 [PAKDD 2025]
  ☆82Updated 2 months ago
• liu673 / Awesome-LLM4Security
  This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.
  ☆196Updated 3 weeks ago
• uiuc-kang-lab / InjecAgent
  ☆62Updated 10 months ago
• rabbitjy / FuzzTuning
  ☆25Updated last year
• thu-coai / SafetyBench
  Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]
  ☆218Updated 10 months ago
• Dizzy-K / AutoPT
  Benchmark data from the article "AutoPT: How Far Are We from End2End Automated Web Penetration Testing?"
  ☆14Updated 6 months ago
• Aatrox103 / SAP
  ☆44Updated last year
• huhusmang / Awesome-LLMs-for-Vulnerability-Detection
  Awesome Large Language Models for Vulnerability Detection
  ☆88Updated this week
• NYU-LLM-CTF / NYU_CTF_Bench
  ☆49Updated last week
• aseec-lab / llms-for-code-analysis
  ☆29Updated 8 months ago
• lucagioacchini / auto-pen-bench
  This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…
  ☆29Updated 6 months ago
• IS2Lab / S-Eval
  S-Eval: Automatic and Adaptive Test Generation for Benchmarking Safety Evaluation of Large Language Models
  ☆64Updated 3 weeks ago
• pasquini-dario / LLMmap
  ☆37Updated 7 months ago
• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆71Updated last month
• ShenaoW / awesome-llm-supply-chain-security
  A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)
  ☆71Updated 3 months ago