trishullab / PutnamBench
An evaluation benchmark for undergraduate competition math in Lean4, Isabelle, Coq, and natural language.
☆93Updated last week
Alternatives and similar repositories for PutnamBench:
Users that are interested in PutnamBench are comparing it to the libraries listed below
- A simple REPL for Lean 4, returning information about errors and sorries.☆106Updated 2 weeks ago
- ☆41Updated last month
- A Machine-to-Machine Interaction System for Lean 4.☆58Updated this week
- Catalog Of Math Problems Formalized In Lean☆141Updated this week
- [COLM 2024] A Survey on Deep Learning for Theorem Proving☆171Updated last month
- An updated version of miniF2F with lots of fixes and informal statements / solutions.☆77Updated 2 months ago
- The official repository for the paper Multilingual Mathematical Autoformalization☆34Updated 10 months ago
- ☆48Updated last month
- LeanEuclid is a benchmark for autoformalization in the domain of Euclidean geometry, targeting the proof assistant Lean.☆87Updated 9 months ago
- Neural theorem proving evaluation via the Lean REPL☆20Updated 5 months ago
- llmstep: [L]LM proofstep suggestions in Lean 4.☆127Updated last year
- https://albertqjiang.github.io/Portal-to-ISAbelle/☆53Updated last year
- Benchmark for undergraduate-level formal mathematics☆103Updated 5 months ago
- Proof artifact co-training for Lean☆43Updated 2 years ago
- Proof recording for Lean 3☆26Updated 3 years ago
- Neural theorem proving toolkit: data extraction tools for Lean 4☆22Updated last week
- ☆32Updated 4 months ago
- ☆64Updated last year
- ImProver: Agent-Based Automated Proof Optimization☆24Updated this week
- ☆27Updated 3 years ago
- ProofNet dataset ported into Lean 4☆19Updated 10 months ago
- A static analysis tool for Lean 4.☆67Updated this week
- Python talking to the Lean theorem prover☆42Updated 3 years ago
- COPRA: An in-COntext PRoof Agent which uses LLMs like GPTs to prove theorems in formal languages.☆58Updated 2 weeks ago
- LLMs + Lean, on your laptop or in the cloud☆138Updated 5 months ago
- Experiments in automation for Lean☆96Updated 2 weeks ago
- Tools based on AI for helping with Lean 4☆77Updated last week
- Isabelle REPL☆20Updated this week
- Formalizing stochastic doubly-efficient debate☆100Updated 5 months ago
- ☆27Updated 2 months ago