This is an evaluation set for the problem of directed/targeted test input generation. We use it to benchmark the ability of Large Language Models for generating inputs to reach a certain code location or produce a particular result.
☆34Mar 11, 2025Updated last year
Alternatives and similar repositories for PathEval
Users that are interested in PathEval are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ISSTA 2025] A Large-scale Empirical Study on Fine-tuning Large Language Models for Unit Testing☆13Feb 9, 2025Updated last year
- A practical fuzzing tool for SMT solvers☆11Nov 26, 2025Updated 11 months ago
- Generating difference exposing tests in Python http://arxiv.org/pdf/2406.10375☆10Sep 5, 2025Updated last year
- ☆165Oct 29, 2026Updated 2 weeks ago
- [ICSE '25] LLM Based Input Space Partitioning Testing for Library APIs☆14Jul 27, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Evaluation code of ASE24 accepted paper "On the Evaluation of LLM in Unit Test Generation"☆13Dec 9, 2024Updated last year
- ☆14Sep 12, 2024Updated 2 years ago
- ☆13Oct 22, 2025Updated last year
- Automatic AI-powered test suite generator☆117Apr 5, 2026Updated 7 months ago
- ☆177Jul 25, 2025Updated last year
- This repository contains several examples of logic bomb.☆117Dec 23, 2023Updated 2 years ago
- Dataset of Codex generated tests for the CodaMosa project☆19Jun 2, 2023Updated 3 years ago
- WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Models (OOPSLA 2024)☆90Aug 5, 2025Updated last year
- ☆13Nov 20, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A learning-guided approach for executing arbitrary Python code snippets☆16Mar 4, 2024Updated 2 years ago
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆78Oct 29, 2025Updated last year
- The repository of data and codes for SynTeR, an LLM-based approach to repair obsolete test cases caused by syntactic BCs.☆16Aug 25, 2024Updated 2 years ago
- Hybrid Program Analysis-Guided Test Generation☆11Jun 15, 2026Updated 5 months ago
- KLEE / CSE Project☆48Apr 3, 2020Updated 6 years ago
- A tool based on python to parse C/C++ code into code property graph☆17Nov 4, 2022Updated 4 years ago
- ☆39Jan 27, 2025Updated last year
- ☆22Dec 28, 2024Updated last year
- Fuzzing Deep-Learning Libraries via Automated Relational API Inference (ESEC/FSE 2022)☆39May 17, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- RulePilot: the first language- and theory-agonistic SIEM Rule generation engine via LLM agents☆16Oct 20, 2025Updated last year
- ☆27Sep 23, 2024Updated 2 years ago
- A continuously updated collection of papers on agentic SE☆640Jul 17, 2026Updated 4 months ago
- Create CFGs and compute complexity metrics for Python, C++, and Java code.☆46May 10, 2024Updated 2 years ago
- PatchEval: A New Benchmark for Evaluating LLMs on Patching Real-World Vulnerabilities☆236Oct 19, 2026Updated last month
- Empc: Effective Path Prioritization for Symbolic Execution with Path Cover☆35May 11, 2025Updated last year
- ☆19Jan 17, 2024Updated 2 years ago
- For our ISSTA22 paper "DocTer: Documentation-Guided Fuzzing for Testing Deep Learning API Functions" by Danning Xie, Yitong Li, Mijung Ki…☆40Jul 19, 2022Updated 4 years ago
- KLEE with floating point support (unmaintained)☆21Feb 15, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Cottontail: A LLM-Driven Concolic Execution Engine (Accepted by IEEE S&P'26)☆47Dec 4, 2025Updated 11 months ago
- The First International Workshop on Large Language Models for Code 2024 (Co-Located with ICSE 2024)☆17Oct 4, 2024Updated 2 years ago
- ConcoLLMic: the first language- and theory-agonistic concolic execution engine via LLM agents☆166Sep 8, 2026Updated 2 months ago
- Official code implementation for the ACL 2025 paper: 'Dynamic Scaling of Unit Tests for Code Reward Modeling'☆27May 16, 2025Updated last year
- ☆11Dec 2, 2024Updated last year
- Generates executable Proof-of-Concept for any bug in any project. AI agents discover and reproduce vulnerabilities — verified, not halluc…☆36May 5, 2026Updated 6 months ago
- CaDiCaL BackBone Analyzer☆12Oct 19, 2024Updated 2 years ago
Are these results useful?