CS-EVAL / CS-Eval
CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.
☆29Updated last month
Alternatives and similar repositories for CS-Eval:
Users that are interested in CS-Eval are comparing it to the libraries listed below
- SC-Safety: 中文大模型多轮对抗安全基准☆117Updated 10 months ago
- ☆34Updated this week
- This is a dataset intended to train a LLM model for a completely CVE focused input and output.☆47Updated last month
- ☆47Updated 6 months ago
- ☆42Updated 8 months ago
- SecGPT: An execution isolation architecture for LLM-based systems☆57Updated last month
- Papers about red teaming LLMs and Multimodal models.☆91Updated last month
- ☆31Updated 3 months ago
- ☆45Updated last month
- 🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.☆18Updated 8 months ago
- A collection of automated evaluators for assessing jailbreak attempts.☆92Updated last week
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆13Updated 2 months ago
- ☆25Updated last year
- [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…☆62Updated 3 months ago
- Agent Security Bench (ASB)☆55Updated last month
- 复旦白泽大模型安全基准测试集（2024年夏季版）☆30Updated 5 months ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆182Updated 6 months ago
- ☆63Updated 3 months ago
- [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆89Updated 3 weeks ago
- ☆85Updated 9 months ago
- CyberMetric dataset☆60Updated 2 weeks ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆44Updated 2 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆57Updated last year
- This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses☆163Updated this week
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆105Updated 7 months ago
- ☆28Updated last month
- ☆67Updated last month
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆107Updated last month
- The opensoure repository of FuzzLLM☆18Updated 8 months ago
- LLM security and privacy☆43Updated 3 months ago