Alternatives and similar repositories for CS-Eval

Users that are interested in CS-Eval are comparing it to the libraries listed below

• cybermetric / CyberMetric
  CyberMetric dataset
  ☆112Updated last year
• tuhh-softsec / LLMSecEval
  ☆55Updated last year
• uiuc-kang-lab / cve-bench
  CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities
  ☆136Updated last week
• LLM-DRA / DRA
  [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…
  ☆111Updated last year
• XuanwuAI / SecEval
  ☆113Updated last year
• tmylla / HackMentor
  The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".
  ☆137Updated last year
• WhitzardIndex / WhitzardBench-2024A
  复旦白泽大模型安全基准测试集（2024年夏季版）
  ☆51Updated last year
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆102Updated 11 months ago
• sherdencooper / GPTFuzz
  Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts
  ☆563Updated last year
• CLUEbenchmark / SuperCLUE-Safety
  SC-Safety: 中文大模型多轮对抗安全基准
  ☆149Updated last year
• agiresearch / ASB
  Agent Security Bench (ASB)
  ☆172Updated 2 months ago
• sherdencooper / PromptFuzz
  ☆29Updated last year
• rabbitjy / FuzzTuning
  ☆25Updated 2 years ago
• lucagioacchini / auto-pen-bench
  This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…
  ☆59Updated 2 months ago
• CSJianYang / SEevenLLM
  ☆39Updated last year
• shuita2333 / AutoDoS
  Consuming Resrouce via Auto-generation for LLM-DoS Attack under Black-box Settings
  ☆18Updated 4 months ago
• ai4cloudops / SecLLMHolmes
  SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…
  ☆63Updated 8 months ago
• PurCL / ASTRA
  🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…
  ☆68Updated 5 months ago
• SolidShen / BAIT
  🔥🔥🔥 Detecting hidden backdoors in Large Language Models with only black-box access
  ☆51Updated 7 months ago
• ShenaoW / awesome-llm-supply-chain-security
  A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)
  ☆91Updated last year
• Aatrox103 / SAP
  ☆48Updated last year
• PurCL / RepoAudit
  An autonomous LLM-agent for large-scale, repository-level code auditing
  ☆314Updated last month
• s2e-lab / SecurityEval
  Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…
  ☆82Updated 2 years ago
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆112Updated last month
• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆116Updated 2 months ago
• liu673 / Awesome-LLM4Security
  This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.
  ☆285Updated last month
• TQRG / secbench
  🪐 A Database of Existing Security Vulnerabilities Patches to Enable Evaluation of Techniques (single-commit; multi-language)
  ☆42Updated 9 months ago
• thu-coai / SafetyBench
  Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]
  ☆267Updated 5 months ago
• ddzipp / AutoAudit
  AutoAudit—— the LLM for Cyber Security 网络安全大语言模型
  ☆356Updated 10 months ago
• LivingFutureLab / ChineseSafetyQA
  ☆34Updated last year