andyzorigin / cybenchLinks
☆173Updated 5 months ago
Alternatives and similar repositories for cybench
Users that are interested in cybench are comparing it to the libraries listed below
Sorting:
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆94Updated last month
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆348Updated 3 weeks ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- ☆96Updated 2 months ago
- Code for the paper "Defeating Prompt Injections by Design"☆150Updated 5 months ago
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆60Updated this week
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆119Updated last week
- A benchmark for prompt injection detection systems.☆150Updated 2 months ago
- ☆65Updated 2 months ago
- Red-Teaming Language Models with DSPy☆235Updated 9 months ago
- Code snippets to reproduce MCP tool poisoning attacks.☆187Updated 7 months ago
- Papers about red teaming LLMs and Multimodal models.☆154Updated 5 months ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆102Updated 3 weeks ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆75Updated 2 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆100Updated 9 months ago
- ☆75Updated 2 weeks ago
- ☆35Updated last year
- ☆50Updated 3 months ago
- Guardrails for secure and robust agent development☆364Updated 3 months ago
- Collection of evals for Inspect AI☆289Updated this week
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆88Updated last year
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆327Updated last year
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆50Updated 3 weeks ago
- LLM proxy to observe and debug what your AI agents are doing.☆54Updated 2 weeks ago
- ☆93Updated last year
- Cyber-Zero: Training Cybersecurity Agents Without Runtime☆39Updated this week
- This repository provides a benchmark for prompt injection attacks and defenses☆343Updated 3 weeks ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆32Updated last year
- A collection of prompt injection mitigation techniques.☆24Updated 2 years ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆122Updated last year