CS-EVAL / CS-Eval
CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.
☆39Updated 4 months ago
Alternatives and similar repositories for CS-Eval:
Users that are interested in CS-Eval are comparing it to the libraries listed below
- CyberMetric dataset☆79Updated 2 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆66Updated 2 months ago
- SC-Safety: 中文大模型多轮对抗安全基准☆128Updated last year
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆114Updated 10 months ago
- ☆89Updated 11 months ago
- ☆33Updated 8 months ago
- ☆40Updated 4 months ago
- [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…☆86Updated 5 months ago
- 复旦白泽大模型安全基准测试集(2024年夏季版)☆35Updated 8 months ago
- ☆30Updated 6 months ago
- ☆57Updated 8 months ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆59Updated last month
- Agent Security Bench (ASB)☆69Updated this week
- This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.☆167Updated 3 months ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆208Updated 9 months ago
- ☆42Updated last month
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆53Updated 4 months ago
- ☆36Updated 5 months ago
- ☆87Updated last month
- Awesome Large Language Models for Vulnerability Detection☆54Updated this week
- ☆43Updated 10 months ago
- 🪐 A Database of Existing Security Vulnerabilities Patches to Enable Evaluation of Techniques (single-commit; multi-language)☆38Updated 2 years ago
- This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking cour…☆49Updated 2 months ago
- LLM security and privacy☆48Updated 5 months ago
- ☆49Updated 3 weeks ago
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆41Updated 6 months ago
- [NDSS'25 Poster] A collection of automated evaluators for assessing jailbreak attempts.☆133Updated 3 weeks ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆471Updated 6 months ago
- Flames is a highly adversarial benchmark in Chinese for LLM's harmlessness evaluation developed by Shanghai AI Lab and Fudan NLP Group.☆44Updated 10 months ago
- ☆29Updated 7 months ago