andyzorigin / cybench
☆93Updated last month
Alternatives and similar repositories for cybench:
Users that are interested in cybench are comparing it to the libraries listed below
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆109Updated last year
- Dataset for the Tensor Trust project☆39Updated last year
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆65Updated 2 weeks ago
- Papers about red teaming LLMs and Multimodal models.☆111Updated 5 months ago
- Red-Teaming Language Models with DSPy☆183Updated 2 months ago
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆45Updated 6 months ago
- ☆59Updated 9 months ago
- Code to break Llama Guard☆31Updated last year
- ☆48Updated 2 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆130Updated 3 weeks ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆44Updated 2 weeks ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆102Updated last year
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆141Updated last year
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆66Updated last year
- Collection of evals for Inspect AI☆115Updated this week
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆68Updated last year
- ☆54Updated 7 months ago
- Awesome LLM Jailbreak academic papers☆94Updated last year
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆67Updated last year
- ☆42Updated 8 months ago
- [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents☆34Updated last month
- Agent Security Bench (ASB)☆76Updated 3 weeks ago
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆50Updated 8 months ago
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆52Updated this week
- ☆20Updated last year
- ☆31Updated 5 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆70Updated 2 months ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆30Updated 10 months ago
- A benchmark for prompt injection detection systems.☆100Updated 2 months ago
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆26Updated 6 months ago