Alternatives and similar repositories for CS-Eval:

Users that are interested in CS-Eval are comparing it to the libraries listed below

• cybermetric / CyberMetric
  CyberMetric dataset
  ☆79Updated 2 months ago
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆66Updated 2 months ago
• CLUEbenchmark / SuperCLUE-Safety
  SC-Safety: 中文大模型多轮对抗安全基准
  ☆128Updated last year
• tmylla / HackMentor
  The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".
  ☆114Updated 10 months ago
• XuanwuAI / SecEval
  ☆89Updated 11 months ago
• CSJianYang / SEevenLLM
  ☆33Updated 8 months ago
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆40Updated 4 months ago
• LLM-DRA / DRA
  [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…
  ☆86Updated 5 months ago
• WhitzardIndex / WhitzardBench-2024A
  复旦白泽大模型安全基准测试集（2024年夏季版）
  ☆35Updated 8 months ago
• pasquini-dario / LLMmap
  ☆30Updated 6 months ago
• uiuc-kang-lab / InjecAgent
  ☆57Updated 8 months ago
• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆59Updated last month
• agiresearch / ASB
  Agent Security Bench (ASB)
  ☆69Updated this week
• liu673 / Awesome-LLM4Security
  This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.
  ☆167Updated 3 months ago
• thu-coai / SafetyBench
  Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]
  ☆208Updated 9 months ago
• NYU-LLM-CTF / NYU_CTF_Bench
  ☆42Updated last month
• ai4cloudops / SecLLMHolmes
  SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…
  ☆53Updated 4 months ago
• tuhh-softsec / LLMSecEval
  ☆36Updated 5 months ago
• andyzorigin / cybench
  ☆87Updated last month
• huhusmang / Awesome-LLMs-for-Vulnerability-Detection
  Awesome Large Language Models for Vulnerability Detection
  ☆54Updated this week
• Aatrox103 / SAP
  ☆43Updated 10 months ago
• TQRG / secbench
  🪐 A Database of Existing Security Vulnerabilities Patches to Enable Evaluation of Techniques (single-commit; multi-language)
  ☆38Updated 2 years ago
• TrustAI-laboratory / Learn-Prompt-Hacking
  This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking cour…
  ☆49Updated 2 months ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆48Updated 5 months ago
• dukeceicenter / jailbreak-reasoning-openai-o1o3-deepseek-r1
  ☆49Updated 3 weeks ago
• Babelscape / ALERT
  Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
  ☆41Updated 6 months ago
• ThuCCSLab / JailbreakEval
  [NDSS'25 Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆133Updated 3 weeks ago
• sherdencooper / GPTFuzz
  Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts
  ☆471Updated 6 months ago
• AI45Lab / Flames
  Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.
  ☆44Updated 10 months ago
• aseec-lab / llms-for-code-analysis
  ☆29Updated 7 months ago