CS-EVAL / CS-EvalLinks
CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.
☆55Updated 11 months ago
Alternatives and similar repositories for CS-Eval
Users that are interested in CS-Eval are comparing it to the libraries listed below
Sorting:
- CyberMetric dataset☆107Updated 10 months ago
- ☆109Updated last year
- ☆52Updated last year
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆130Updated last year
- 复旦白泽大模型安全基准测试集（2024年夏季版）☆47Updated last year
- ☆38Updated last year
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆48Updated 3 weeks ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆98Updated 9 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆113Updated last week
- [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…☆110Updated last year
- Agent Security Bench (ASB)☆144Updated 3 weeks ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆63Updated 6 months ago
- SC-Safety: 中文大模型多轮对抗安全基准☆146Updated last year
- This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.☆273Updated last month
- ☆26Updated last year
- ☆34Updated last year
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆542Updated last year
- AutoAudit—— the LLM for Cyber Security 网络安全大语言模型☆353Updated 8 months ago
- 🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…☆62Updated 3 months ago
- ☆25Updated 2 years ago
- JailBench：大型语言模型越狱攻击风险评测中文数据集 [PAKDD 2025]☆142Updated 8 months ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆261Updated 3 months ago
- MCPSafetyScanner - Automated MCP safety auditing and remediation using Agents. More info: https://www.arxiv.org/abs/2504.03767☆152Updated 7 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆80Updated 2 years ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆90Updated last month
- ☆98Updated last year
- AutoMSS 是基于AI Agent实现的针对安全事件自动化分析研判的系统，由cloud Totem团队开发，希望有兴趣的朋友可以一起参与进来更新和完善。邮箱联系：automss@cloud-totem.com☆50Updated last year
- ☆46Updated last year
- VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo☆66Updated 7 months ago
- ☆33Updated 10 months ago