LiveCodeBench / LiveCodeBenchLinks
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
☆616Updated 3 weeks ago
Alternatives and similar repositories for LiveCodeBench
Users that are interested in LiveCodeBench are comparing it to the libraries listed below
Sorting:
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆409Updated 3 months ago
- Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆573Updated 4 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆516Updated last week
- Scaling Data for SWE-agents☆342Updated this week
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆226Updated last week
- [ICML 2025 Oral] CodeI/O: Condensing Reasoning Patterns via Code Input-Output Prediction☆537Updated 3 months ago
- The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]☆265Updated 5 months ago
- ☆608Updated 3 weeks ago
- Arena-Hard-Auto: An automatic LLM benchmark.☆889Updated last month
- A simple unified framework for evaluating LLMs☆235Updated 3 months ago
- ☆954Updated 6 months ago
- A project to improve skills of large language models☆501Updated this week
- Automatic evals for LLMs☆496Updated last month
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆169Updated 11 months ago
- ☆870Updated last month
- Run evaluation on LLMs using human-eval benchmark☆417Updated last year
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆309Updated 5 months ago
- A framework for the evaluation of autoregressive code generation language models.☆971Updated 2 weeks ago
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆744Updated 4 months ago
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆201Updated 3 weeks ago
- AN O1 REPLICATION FOR CODING☆336Updated 7 months ago
- ☆320Updated 10 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆679Updated last week
- Code for Quiet-STaR☆737Updated 11 months ago
- RewardBench: the first evaluation tool for reward models.☆622Updated last month
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆378Updated 10 months ago
- Code and Data for Tau-Bench☆742Updated 3 weeks ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆153Updated last year
- Large Reasoning Models☆804Updated 8 months ago
- xLAM: A Family of Large Action Models to Empower AI Agent Systems☆513Updated this week