LiveCodeBench / LiveCodeBenchLinks
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
☆688Updated 3 months ago
Alternatives and similar repositories for LiveCodeBench
Users that are interested in LiveCodeBench are comparing it to the libraries listed below
Sorting:
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆440Updated 2 weeks ago
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆610Updated 7 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆553Updated 3 months ago
- [ICML 2025 Oral] CodeI/O: Condensing Reasoning Patterns via Code Input-Output Prediction☆556Updated 5 months ago
- [NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents☆432Updated last week
- A project to improve skills of large language models☆594Updated this week
- Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving☆268Updated this week
- Arena-Hard-Auto: An automatic LLM benchmark.☆948Updated 4 months ago
- The code and data for "MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark" [NeurIPS 2024]☆305Updated 8 months ago
- Automatic evals for LLMs☆550Updated 4 months ago
- ☆981Updated 3 months ago
- Large Reasoning Models☆805Updated 10 months ago
- A framework for the evaluation of autoregressive code generation language models.☆986Updated 3 months ago
- ☆964Updated 9 months ago
- Run evaluation on LLMs using human-eval benchmark☆420Updated 2 years ago
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆319Updated 8 months ago
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆420Updated last year
- A simple unified framework for evaluating LLMs☆254Updated 6 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,101Updated this week
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆174Updated last year
- AN O1 REPLICATION FOR CODING☆336Updated 10 months ago
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆782Updated 7 months ago
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆218Updated last week
- ☆319Updated last year
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆353Updated last year
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆296Updated this week
- Code for Quiet-STaR☆739Updated last year
- Code and Data for Tau-Bench☆901Updated 2 months ago
- Reproducible, flexible LLM evaluations☆257Updated last week
- LiveBench: A Challenging, Contamination-Free LLM Benchmark☆902Updated 2 weeks ago