CS-EVAL / CS-EvalLinks
CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.
☆43Updated 7 months ago
Alternatives and similar repositories for CS-Eval
Users that are interested in CS-Eval are comparing it to the libraries listed below
Sorting:
- CyberMetric dataset☆94Updated 6 months ago
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆124Updated last year
- ☆99Updated last year
- JailBench：大型语言模型越狱攻击风险评测中文数据集 [PAKDD 2025]☆106Updated 4 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆83Updated 5 months ago
- SC-Safety: 中文大模型多轮对抗安全基准☆141Updated last year
- [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…☆99Updated 9 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆62Updated last month
- ☆35Updated last year
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆504Updated 9 months ago
- ☆45Updated 9 months ago
- ☆30Updated 6 months ago
- 复旦白泽大模型安全基准测试集（2024年夏季版）☆41Updated 11 months ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆228Updated last year
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆35Updated last week
- Automated Safety Testing of Large Language Models☆16Updated 5 months ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆86Updated this week
- Agent Security Bench (ASB)☆94Updated last month
- ☆48Updated 9 months ago
- ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]☆204Updated 9 months ago
- Benchmark data from the article "AutoPT: How Far Are We from End2End Automated Web Penetration Testing?"☆16Updated 8 months ago
- ☆26Updated 8 months ago
- AutoAudit—— the LLM for Cyber Security 网络安全大语言模型☆340Updated 4 months ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆44Updated 3 weeks ago
- ☆75Updated 7 months ago
- This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.☆220Updated last week
- ☆25Updated last year
- ☆67Updated last year
- ☆45Updated last year
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆58Updated 2 months ago