Evaluating Program Reasoning of LLMs via Formal Specification Inference (ACL 2025)
☆19Sep 21, 2025Updated last year
Alternatives and similar repositories for FormalBench
Users that are interested in FormalBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- CAShift: Benchmarking Log-Based Cloud Attack Detection under Normality Shift (FSE 2025)☆16Jun 25, 2026Updated 3 months ago
- Artifact of TOSEM accepted paper: "Try with Simpler - An Evaluation of Improved PCA in Log-based Anomaly Detection."☆12Dec 31, 2022Updated 3 years ago
- Demonstration-Free: Towards More Practical Log Parsing with Large Language Models☆32Jun 17, 2025Updated last year
- ☆15Jun 6, 2024Updated 2 years ago
- Replication of AST Neural Network from Zhang J. et. al (2019) and application to software vulnerability detection☆12Jan 13, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for (MobiCom24) Delta: A Cloud-assisted Data Enrichment Framework for On-Device Continual Learning☆14Dec 10, 2024Updated last year
- Programs for producing static and dynamic (runtime) call graphs for Java programs☆15Aug 23, 2021Updated 5 years ago
- The dataset, source code and the results of our ESEC/FSE 2023 paper "An Extensive Study on Adversarial Attack against Pre-trained Models …☆15Feb 19, 2024Updated 2 years ago
- An experimental library for metaprogramming with algebraic effects and handlers☆55Updated this week
- A Quantum Computing Library in LEAN☆26Jul 14, 2026Updated 2 months ago
- AlphaVerus: Formally Verified Code Generation through Self-Improving Translation and Treefinement☆34May 14, 2025Updated last year
- ☆23Apr 17, 2023Updated 3 years ago
- ☆14Feb 7, 2020Updated 6 years ago
- The public blockchain vulnerability dataset released in our FSE'22 paper☆10Aug 22, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆24Nov 14, 2024Updated last year
- Machine Learning for Mathematics and Logics☆16Apr 1, 2025Updated last year
- AutoPruner: Transformer-based Call Graph Pruning (ESEC/FSE 2022, Research Track)☆22Dec 7, 2023Updated 2 years ago
- Code for Doubly deformable aggregation of covariance matrices for few-shot segmentation☆16Oct 25, 2022Updated 3 years ago
- ☆119Aug 24, 2026Updated last month
- LogShrink: Effective Log Compression by Leveraging Commonality and Variability of Log Data [ICSE'24 early]☆25Nov 14, 2023Updated 2 years ago
- ☆25Nov 17, 2025Updated 10 months ago
- DafnyBench: A Benchmark for Formal Software Verification☆68Dec 12, 2024Updated last year
- Verina (Verifiable Code Generation Arena) is a high-quality benchmark enabling a comprehensive and modular evaluation of code, specificat…☆82Aug 17, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repo illustrates how to evaluate the artifacts in the paper An Extensive Study on Pre-trained Models for Program Understanding and G…☆26Aug 12, 2022Updated 4 years ago
- compare the theory attention gradient with PyTorch attention gradient☆16Apr 1, 2024Updated 2 years ago
- ☆51Jun 5, 2026Updated 4 months ago
- Pytorch implementation for "Video Joint Modelling Based on Hierarchical Transformer for Co-summarization"☆15Aug 24, 2025Updated last year
- ☆30Apr 2, 2023Updated 3 years ago
- ☆17Nov 10, 2025Updated 11 months ago
- ☆14Jan 8, 2023Updated 3 years ago
- I/O utilities and datasets for algebraic-graphs☆14Aug 29, 2022Updated 4 years ago
- Code for paper "FuSeConv Fully Separable Convolutions for Fast Inference on Systolic Arrays" published at DATE 2021☆18Aug 23, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AI-Assisted Verification of Data Structures☆23May 27, 2026Updated 4 months ago
- ☆14Jan 13, 2023Updated 3 years ago
- ICM-Assistant: Instruction-tuning Multimodal Large Language Models for Rule-based Explainable Image Content Moderation. AAAI, 2025☆16Aug 25, 2025Updated last year
- Repository of benchmarks for SYNTCOMP☆16Sep 2, 2026Updated last month
- ☆29Sep 26, 2026Updated last week
- CLEVER: Code Lean Evaluation for Verified End-to-end Reasoning☆49Aug 26, 2026Updated last month
- Implements Global Word Vectors.☆11Feb 8, 2020Updated 6 years ago