Alternatives and similar repositories for CS-Eval

Users that are interested in CS-Eval are comparing it to the libraries listed below

• cybermetric / CyberMetric
  CyberMetric dataset
  ☆98Updated 7 months ago
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆89Updated 6 months ago
• tuhh-softsec / LLMSecEval
  ☆47Updated 10 months ago
• XuanwuAI / SecEval
  ☆102Updated last year
• tmylla / HackMentor
  The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".
  ☆129Updated last year
• uiuc-kang-lab / cve-bench
  CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities
  ☆78Updated last month
• sherdencooper / GPTFuzz
  Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts
  ☆521Updated 11 months ago
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆86Updated 9 months ago
• agiresearch / ASB
  Agent Security Bench (ASB)
  ☆108Updated 2 months ago
• CLUEbenchmark / SuperCLUE-Safety
  SC-Safety: 中文大模型多轮对抗安全基准
  ☆142Updated last year
• rabbitjy / FuzzTuning
  ☆25Updated last year
• Aatrox103 / SAP
  ☆45Updated last year
• sunblaze-ucb / cybergym
  CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…
  ☆52Updated last month
• RainJamesY / FuzzLLM
  The opensoure repository of FuzzLLM
  ☆28Updated last year
• LLM-DRA / DRA
  [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…
  ☆102Updated 10 months ago
• sherdencooper / PromptFuzz
  ☆26Updated 10 months ago
• STAIR-BUPT / JailBench
  JailBench：大型语言模型越狱攻击风险评测中文数据集 [PAKDD 2025]
  ☆119Updated 5 months ago
• thu-coai / SafetyBench
  Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]
  ☆241Updated last month
• lucagioacchini / auto-pen-bench
  This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…
  ☆36Updated last month
• WhitzardIndex / WhitzardBench-2024A
  复旦白泽大模型安全基准测试集（2024年夏季版）
  ☆44Updated last year
• ai4cloudops / SecLLMHolmes
  SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…
  ☆57Updated 3 months ago
• CSJianYang / SEevenLLM
  ☆35Updated last year
• pasquini-dario / LLMmap
  ☆59Updated last month
• ddzipp / AutoAudit
  AutoAudit—— the LLM for Cyber Security 网络安全大语言模型
  ☆345Updated 6 months ago
• liu673 / Awesome-LLM4Security
  This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.
  ☆239Updated 3 weeks ago
• s2e-lab / SecurityEval
  Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…
  ☆75Updated last year
• thu-coai / ShieldLM
  ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]
  ☆208Updated 11 months ago
• uiuc-kang-lab / InjecAgent
  ☆71Updated last year
• aseec-lab / llms-for-code-analysis
  ☆31Updated last year
• kaichenorg / vulrule
  漏洞规则库是一个致力于帮助开发者识别和避免常见安全漏洞的开源项目。我们收集、整理和分析各类编程语言和常用库中的安全漏洞模式，并提供相应的防范措施和最佳实践。
  ☆27Updated 2 weeks ago