CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
☆75Feb 3, 2025Updated last year
Alternatives and similar repositories for CodeElo
Users that are interested in CodeElo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2025 D&B Track] Evaluation Code Repo for Paper "PolyMath: Evaluating Mathematical Reasoning in Multilingual Contexts"☆44May 22, 2025Updated last year
- ☆14Jul 5, 2024Updated 2 years ago
- ☆178Dec 13, 2025Updated 11 months ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆978Jul 16, 2025Updated last year
- Based on the R1-Zero method, using rule-based rewards and GRPO on the Code Contests dataset.☆18Apr 22, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Web page for "🍅HumanTOMATO: Text-aligned Whole-body Motion Generation".☆15May 25, 2024Updated 2 years ago
- 赛博苏神:你的 research 好老师☆15Jun 16, 2026Updated 5 months ago
- ☆13Aug 12, 2026Updated 3 months ago
- ☆18Mar 28, 2026Updated 7 months ago
- ☆16Feb 6, 2024Updated 2 years ago
- Reproducing R1 for Code with Reliable Rewards☆320May 5, 2025Updated last year
- The evaluation code for MultiIF multi-turn and multi-lingual instruction following☆63Oct 29, 2024Updated 2 years ago
- LLM play 20questions with itself☆13Mar 31, 2023Updated 3 years ago
- A library used for generating C# classes from DTDL interfaces.☆15Jul 9, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆174Oct 11, 2024Updated 2 years ago
- NaturalCodeBench (Findings of ACL 2024)☆71Oct 14, 2024Updated 2 years ago
- ☆11Aug 10, 2025Updated last year
- ☆13Jul 14, 2024Updated 2 years ago
- Seed-Coder is a family of lightweight open-source code LLMs comprising base, instruct and reasoning models, developed by ByteDance Seed.☆762Jun 6, 2025Updated last year
- Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"☆197May 20, 2025Updated last year
- A tool to build a graph from a codebase☆14Feb 19, 2025Updated last year
- ☆15Jan 21, 2025Updated last year
- SIFT: Grounding LLM Reasoning in Contexts via Stickers☆58Mar 6, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Jun 5, 2024Updated 2 years ago
- ☆1,206Jan 10, 2026Updated 10 months ago
- LLM evaluation on 2024 Chinese Gaokao Mathematics — zero-contamination benchmark with dual prompt formats☆21Apr 15, 2026Updated 7 months ago
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆20Jul 4, 2025Updated last year
- Golang package for setting/retrieving a device id.☆18Apr 24, 2025Updated last year
- XTlib is an API and command line tool for scaling and managing ML experiments. The goal of XTLib is to enable you to effortlessly organi…☆16Jul 5, 2023Updated 3 years ago
- StepFun-Formalizer: Unlocking the Autoformalization Potential of LLMs through Knowledge-Reasoning Fusion☆29Aug 19, 2025Updated last year
- ☆16Aug 12, 2026Updated 3 months ago
- Large language models designed for formal theorem proving through tool-integrated reasoning.☆33Aug 13, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆28Dec 18, 2024Updated last year
- ☆42Oct 22, 2026Updated 3 weeks ago
- ☆38Updated this week
- LLM RL envs done right, plus some training code☆17Feb 1, 2026Updated 9 months ago
- ☆241Feb 28, 2026Updated 8 months ago
- Naive Android Screen Stream Reader, this project decodes screenrecord stream from an Android device to OpenCV. Written in Python☆13May 27, 2023Updated 3 years ago
- ☆24Oct 10, 2025Updated last year
Are these results useful?