eth-sri / ToolFuzzLinks
ToolFuzz is a fuzzing framework designed to test your LLM Agent tools.
☆19Updated 3 months ago
Alternatives and similar repositories for ToolFuzz
Users that are interested in ToolFuzz are comparing it to the libraries listed below
Sorting:
- A better way of testing, inspecting, and analyzing AI Agent traces.☆38Updated last month
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆56Updated 3 months ago
- Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.☆53Updated 3 months ago
- Let Claude control a web browser on your machine.☆32Updated 3 weeks ago
- [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.☆43Updated 2 weeks ago
- (Discontinued) Non-Pydantic, Non-JSON Schema, efficient AutoPrompting and Structured Output Library☆28Updated last month
- Visualize any repo or codebase into diagram or animation☆18Updated 8 months ago
- Enhancing AI Software Engineering with Repository-level Code Graph☆185Updated 2 months ago
- ☆96Updated 9 months ago
- Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)☆86Updated 3 months ago
- Challenges for general-purpose web-browsing AI agents☆58Updated 3 weeks ago
- LLM-based mutation testing☆11Updated 4 months ago
- Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…☆13Updated 2 months ago
- ☆16Updated 5 months ago
- Test Generation for Prompts☆106Updated this week
- ☆121Updated last month
- [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation☆50Updated 3 weeks ago
- a Python library that uses Reinforcement Learning (RL) to train LLMs.☆30Updated last month
- Easiest way to build custom agents, in a no-code notion style editor, using simple macros.☆27Updated 7 months ago
- ☆50Updated last month
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆51Updated 2 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆68Updated 3 months ago
- Data and evaluation scripts for "CodePlan: Repository-level Coding using LLMs and Planning", FSE 2024☆71Updated 9 months ago
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆70Updated last year
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆58Updated 6 months ago
- The Granite Guardian models are designed to detect risks in prompts and responses.☆88Updated this week
- Guardrails for secure and robust agent development☆305Updated 3 weeks ago
- ☆26Updated 11 months ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆91Updated 2 months ago
- SWE Arena☆34Updated 2 months ago