Alternatives and similar repositories for bigcodebench-annotation

Users that are interested in bigcodebench-annotation are comparing it to the libraries listed below

• crux-eval / eval-arena
  ☆28Updated this week
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆62Updated last year
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆166Updated 2 months ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆62Updated last year
• huggingface / ioi
  ☆39Updated 6 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆106Updated 2 months ago
• shunzh / Code-AI-Tree-Search
  ☆119Updated last year
• protagolabs / odyssey-math
  ☆84Updated 8 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆36Updated 10 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆65Updated 7 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆82Updated last year
• CodeEditorBench / CodeEditorBench
  ☆53Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 10 months ago
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆141Updated last year
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] ReasonFlux-Coder: Open-Source LLM Coders with Co-Evolving Reinforcement Learning
  ☆122Updated 2 weeks ago
• google-research / arcade-nl2code
  ☆54Updated 2 years ago
• SalesforceAIResearch / swecomm
  ☆28Updated 8 months ago
• SparksofAGI / MHPP
  ☆32Updated 3 weeks ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆59Updated last year
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆145Updated 10 months ago
• microsoft / LEMA
  official repo for the paper "Learning From Mistakes Makes LLM Better Reasoner"
  ☆58Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆85Updated 4 months ago
• OSU-NLP-Group / llm-planning-eval
  [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"
  ☆54Updated last year
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆105Updated 7 months ago
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆129Updated last month
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 5 months ago
• Zayne-sprague / MuSR
  ☆52Updated last year
• rmshin / llm-mcts
  ☆41Updated last year
• Ablustrund / APPS_Plus
  StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
  ☆70Updated last year