andyzorigin / cybenchLinks
☆190Updated last month
Alternatives and similar repositories for cybench
Users that are interested in cybench are comparing it to the libraries listed below
Sorting:
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆108Updated 3 weeks ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆425Updated this week
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- Code for the paper "Defeating Prompt Injections by Design"☆246Updated 7 months ago
- ☆117Updated 4 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆146Updated 3 weeks ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆79Updated 5 months ago
- Red-Teaming Language Models with DSPy☆250Updated 11 months ago
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆63Updated last week
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆122Updated 3 months ago
- A benchmark for prompt injection detection systems.☆158Updated last month
- Papers about red teaming LLMs and Multimodal models.☆159Updated 8 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆103Updated last year
- Guardrails for secure and robust agent development☆384Updated 3 weeks ago
- Cyber-Zero: Training Cybersecurity Agents Without Runtime☆69Updated last week
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆338Updated last year
- Collection of evals for Inspect AI☆357Updated this week
- ☆66Updated 4 months ago
- ☆58Updated 6 months ago
- ☆81Updated 3 months ago
- LLM proxy to observe and debug what your AI agents are doing.☆64Updated 3 months ago
- Code snippets to reproduce MCP tool poisoning attacks.☆192Updated 9 months ago
- This repository provides a benchmark for prompt injection attacks and defenses in LLMs☆384Updated 3 months ago
- ☆114Updated last year
- Risks and targets for assessing LLMs & LLM vulnerabilities☆33Updated last year
- ☆50Updated last year
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆103Updated last year
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆452Updated last year
- A collection of prompt injection mitigation techniques.☆27Updated 2 years ago
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆64Updated 3 months ago