Alternatives and similar repositories for OpenCodeEval

Users that are interested in OpenCodeEval are comparing it to the libraries listed below

• tongyx361 / symeval
  Evaluation utilities based on SymPy.
  ☆20Updated 8 months ago
• hkust-nlp / dart-math
  [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*
  ☆112Updated 8 months ago
• ZubinGou / math-evaluation-harness
  A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨
  ☆241Updated last year
• QwenLM / ProcessBench
  Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"
  ☆169Updated 2 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆219Updated 5 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆49Updated 9 months ago
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆112Updated 4 months ago
• princeton-pli / LongProc
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆26Updated last month
• OpenBMB / InfiniteBench
  Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718
  ☆344Updated 10 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆170Updated last month
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆184Updated 10 months ago
• KbsdJames / Omni-MATH
  The official repository of the Omni-MATH benchmark.
  ☆87Updated 7 months ago
• TIGER-AI-Lab / verl-tool
  A version of verl to support tool use
  ☆328Updated this week
• IAAR-Shanghai / xVerify
  xVerify: Efficient Answer Verifier for Reasoning Model Evaluations
  ☆127Updated 3 months ago
• OpenMOSS / Thus-Spake-Long-Context-LLM
  a survey of long-context LLMs from four perspectives, architecture, infrastructure, training, and evaluation
  ☆55Updated 4 months ago
• tongyx361 / Awesome-LLM4Math
  Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…
  ☆133Updated last year
• ganler / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆246Updated 3 months ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆67Updated 8 months ago
• GAIR-NLP / LIMR
  ☆206Updated 5 months ago
• eddycmu / demystify-long-cot
  ☆310Updated 2 months ago
• OpenBMB / OlympiadBench
  [ACL 2024]Official GitHub repo for OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scie…
  ☆165Updated 2 months ago
• mtbench101 / mt-bench-101
  [ACL 2024] MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
  ☆105Updated last year
• multimodal-art-projection / KORGym
  ☆48Updated 2 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆65Updated 8 months ago
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆127Updated last year
• phonism / CP-Zero
  Based on the R1-Zero method, using rule-based rewards and GRPO on the Code Contests dataset.
  ☆17Updated 3 months ago
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆163Updated 3 weeks ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆61Updated 8 months ago
• QwenLM / CodeElo
  CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
  ☆48Updated 6 months ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆68Updated 11 months ago