andyzorigin / cybenchLinks
☆116Updated 2 weeks ago
Alternatives and similar repositories for cybench
Users that are interested in cybench are comparing it to the libraries listed below
Sorting:
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆193Updated last week
- Risks and targets for assessing LLMs & LLM vulnerabilities☆30Updated last year
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆30Updated this week
- Red-Teaming Language Models with DSPy☆198Updated 4 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- ☆34Updated 7 months ago
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆56Updated last week
- ☆66Updated 11 months ago
- Dataset for the Tensor Trust project☆43Updated last year
- Code to break Llama Guard☆31Updated last year
- A benchmark for prompt injection detection systems.☆120Updated last month
- ☆56Updated last month
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆61Updated last week
- LLM security and privacy☆48Updated 8 months ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆108Updated last year
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆83Updated 2 months ago
- ☆20Updated last year
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆69Updated last year
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆49Updated 8 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆72Updated last year
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆51Updated 10 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆82Updated 4 months ago
- Collection of evals for Inspect AI☆167Updated this week
- Papers about red teaming LLMs and Multimodal models.☆123Updated last month
- ☆65Updated 5 months ago
- ☆45Updated 10 months ago
- ☆44Updated 8 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆56Updated 3 months ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆51Updated 2 months ago
- [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents☆39Updated last month