Evaluating Program Reasoning of LLMs via Formal Specification Inference (ACL 2025)
☆20Sep 21, 2025Updated last year
Alternatives and similar repositories for FormalBench
Users that are interested in FormalBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Treasury and Liquidity Management (TLM) - This is a highly complex, critical back-office function. Agentic systems can optimize cash flow…☆11Jul 7, 2025Updated last year
- Repo for PLAN's verified code generation project☆13Aug 2, 2025Updated last year
- ☆12Jul 26, 2026Updated 3 months ago
- The QIR Execution Engine library provides interfaces for easily processing Quantum Intermediate Representation code using the LLVM execut…☆14May 5, 2026Updated 5 months ago
- AI-Assisted Verification of Data Structures☆25May 27, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Replication of AST Neural Network from Zhang J. et. al (2019) and application to software vulnerability detection☆12Jan 13, 2020Updated 6 years ago
- Translating humaneval into dafny☆12Mar 31, 2025Updated last year
- Code repository for the Variational Quantum State Diagonalization algorithm.☆14Aug 27, 2019Updated 7 years ago
- The dataset, source code and the results of our ESEC/FSE 2023 paper "An Extensive Study on Adversarial Attack against Pre-trained Models …☆15Feb 19, 2024Updated 2 years ago
- generating formally verified C code with LLMs (thesis Merlijn Sevenhuijsen) http://urn.kb.se/resolve?urn=urnsediva-356745☆14Jun 7, 2026Updated 4 months ago
- american fuzzy lop - a security-oriented fuzzer☆11Feb 25, 2026Updated 8 months ago
- Code for (MobiCom24) Delta: A Cloud-assisted Data Enrichment Framework for On-Device Continual Learning☆14Dec 10, 2024Updated last year
- junit tools contest infrastructure☆13Feb 9, 2024Updated 2 years ago
- Experiments codes for SIGKDD '22 paper "User-Event Graph Embedding Learning for Context-Aware Recommendation"☆10Aug 14, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆23Apr 17, 2023Updated 3 years ago
- Apple Foundation Models CLI Access☆19Jul 22, 2026Updated 3 months ago
- AlphaVerus: Formally Verified Code Generation through Self-Improving Translation and Treefinement☆35May 14, 2025Updated last year
- ☆14Feb 7, 2020Updated 6 years ago
- The public blockchain vulnerability dataset released in our FSE'22 paper☆10Aug 22, 2022Updated 4 years ago
- An experimental library for metaprogramming with algebraic effects and handlers☆55Updated this week
- A fork of Cerberus C adding a Lean 4 port of the semantics☆15Updated this week
- Machine Learning for Mathematics and Logics☆16Apr 1, 2025Updated last year
- ☆15Oct 11, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- week 1 coding assignment☆13Jun 25, 2022Updated 4 years ago
- ☆25Nov 17, 2025Updated 11 months ago
- Verina (Verifiable Code Generation Arena) is a high-quality benchmark enabling a comprehensive and modular evaluation of code, specificat…☆83Aug 17, 2026Updated 2 months ago
- ☆17Nov 10, 2025Updated 11 months ago
- High-performance simulator for executing QIR on GPU and CPU backends☆23Oct 2, 2022Updated 4 years ago
- Code for the ICRA 2024 Cook2LTL paper on translating free-form cooking recipes to Linear Temporal Logic (LTL) formulae for robot task pla…☆22Oct 18, 2024Updated 2 years ago
- compare the theory attention gradient with PyTorch attention gradient☆16Apr 1, 2024Updated 2 years ago
- This repo illustrates how to evaluate the artifacts in the paper An Extensive Study on Pre-trained Models for Program Understanding and G…☆26Aug 12, 2022Updated 4 years ago
- I/O utilities and datasets for algebraic-graphs☆14Aug 29, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Remove outdated compilation artefacts left by cabal v2-build☆11Apr 11, 2026Updated 6 months ago
- ICM-Assistant: Instruction-tuning Multimodal Large Language Models for Rule-based Explainable Image Content Moderation. AAAI, 2025☆16Aug 25, 2025Updated last year
- ☆14Jan 13, 2023Updated 3 years ago
- Clover: Closed-Loop Verifiable Code Generation☆50May 12, 2025Updated last year
- ☆52Jun 5, 2026Updated 4 months ago
- [ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.☆30Apr 21, 2025Updated last year
- A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languages☆20Jun 11, 2026Updated 4 months ago