Evaluating Program Reasoning of LLMs via Formal Specification Inference (ACL 2025)
☆18Sep 21, 2025Updated 11 months ago
Alternatives and similar repositories for FormalBench
Users that are interested in FormalBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Artifact of TOSEM accepted paper: "Try with Simpler - An Evaluation of Improved PCA in Log-based Anomaly Detection."☆12Dec 31, 2022Updated 3 years ago
- Demonstration-Free: Towards More Practical Log Parsing with Large Language Models☆32Jun 17, 2025Updated last year
- The dataset, source code and the results of our ESEC/FSE 2023 paper "An Extensive Study on Adversarial Attack against Pre-trained Models …☆15Feb 19, 2024Updated 2 years ago
- american fuzzy lop - a security-oriented fuzzer☆11Feb 25, 2026Updated 6 months ago
- An experimental library for metaprogramming with algebraic effects and handlers☆54Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Quantum Computing Library in LEAN☆24Jul 14, 2026Updated 2 months ago
- AlphaVerus: Formally Verified Code Generation through Self-Improving Translation and Treefinement☆34May 14, 2025Updated last year
- ☆23Apr 17, 2023Updated 3 years ago
- SV-Sim: Scalable PGAS-based State Vector Simulation of Quantum Circuits☆22Feb 2, 2024Updated 2 years ago
- The public blockchain vulnerability dataset released in our FSE'22 paper☆10Aug 22, 2022Updated 4 years ago
- ☆23Nov 14, 2024Updated last year
- Machine Learning for Mathematics and Logics☆16Apr 1, 2025Updated last year
- AutoPruner: Transformer-based Call Graph Pruning (ESEC/FSE 2022, Research Track)☆22Dec 7, 2023Updated 2 years ago
- ☆116Aug 24, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- LogShrink: Effective Log Compression by Leveraging Commonality and Variability of Log Data [ICSE'24 early]☆25Nov 14, 2023Updated 2 years ago
- ☆24Nov 17, 2025Updated 10 months ago
- DafnyBench: A Benchmark for Formal Software Verification☆68Dec 12, 2024Updated last year
- ☆15Oct 11, 2023Updated 2 years ago
- Verina (Verifiable Code Generation Arena) is a high-quality benchmark enabling a comprehensive and modular evaluation of code, specificat…☆77Aug 17, 2026Updated last month
- compare the theory attention gradient with PyTorch attention gradient☆16Apr 1, 2024Updated 2 years ago
- ☆51Jun 5, 2026Updated 3 months ago
- Rotation gate synthesis for early fault-tolerant quantum computing☆17Apr 27, 2026Updated 4 months ago
- A powerful voice-only mouse☆32Aug 8, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆30Apr 2, 2023Updated 3 years ago
- ☆17Nov 10, 2025Updated 10 months ago
- ☆14Jan 8, 2023Updated 3 years ago
- AI-Assisted Verification of Data Structures☆23May 27, 2026Updated 3 months ago
- ☆14Jan 13, 2023Updated 3 years ago
- ⚙️ TestContainers ArangoDB module implementation.☆12Nov 25, 2025Updated 9 months ago
- Repository of benchmarks for SYNTCOMP☆16Sep 2, 2026Updated 2 weeks ago
- ☆29Sep 9, 2026Updated last week
- CLEVER: Code Lean Evaluation for Verified End-to-end Reasoning☆49Aug 26, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- (AAAI 2026) OSVBench, a new benchmark for evaluating Large Language Models (LLMs) in generating complete specification code pertaining to…☆16May 13, 2025Updated last year
- LeanDojo-v2 is an end-to-end framework for training, evaluating, and deploying AI-assisted theorem provers for Lean 4.☆138Aug 10, 2026Updated last month
- ☆24Aug 30, 2025Updated last year
- The bootstrapping PEG parser☆10Feb 18, 2024Updated 2 years ago
- Haskell bindings to llama.cpp☆12Dec 22, 2023Updated 2 years ago
- Plugin files for editing K files☆12Aug 20, 2024Updated 2 years ago
- Tools for quantum circuits synthesis, optimization and others.☆27Jun 29, 2026Updated 2 months ago