Alternatives and similar repositories for infibench-evaluator

Users that are interested in infibench-evaluator are comparing it to the libraries listed below

• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆64Updated last year
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆165Updated last year
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆63Updated last year
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆128Updated last year
• InternLM / SWE-Fixer
  ☆131Updated 9 months ago
• crux-eval / eval-arena
  ☆33Updated last week
• CodeEditorBench / CodeEditorBench
  ☆56Updated last year
• SparksofAGI / MHPP
  ☆33Updated 4 months ago
• SalesforceAIResearch / swecomm
  ☆28Updated 3 months ago
• Ablustrund / APPS_Plus
  StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
  ☆74Updated last year
• r2e-project / r2e
  [ICML '24] R2E: Turn any GitHub Repository into a Programming Agent Environment
  ☆140Updated 9 months ago
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆37Updated last year
• gonglinyuan / safim
  ☆44Updated 9 months ago
• MLE-Dojo / MLE-Dojo
  ☆90Updated 3 months ago
• CodeEval-Pro / CodeEval-Pro
  [ACL'25 Findings] Official repo for "HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Task"
  ☆37Updated 10 months ago
• ise-uiuc / xft
  XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
  ☆35Updated last year
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)
  ☆73Updated last year
• R2E-Gym / R2E-Gym
  [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents
  ☆236Updated 6 months ago
• evo-eval / evoeval
  EvoEval: Evolving Coding Benchmarks via LLM
  ☆81Updated last year
• zhenyuhe00 / SWE-Swiss
  SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution
  ☆104Updated 4 months ago
• SalesforceAIResearch / LaTRO
  ☆123Updated 11 months ago
• aorwall / moatless-testbeds
  Moatless Testbeds allows you to create isolated testbed environments in a Kubernetes cluster where you can apply code changes through git…
  ☆14Updated 10 months ago
• bigcode-project / bigcodebench-annotation
  BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
  ☆25Updated last year
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆169Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆93Updated last year
• THUDM / SWE-Dev
  [ACL25' Findings] SWE-Dev is an SWE agent with a scalable test case construction pipeline.
  ☆58Updated 6 months ago
• aorwall / moatless-tree-search
  ☆132Updated 8 months ago
• GAIR-NLP / OlympicArena
  [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
  ☆107Updated 11 months ago
• TIGER-AI-Lab / LongICLBench
  Code and Data for "Long-context LLMs Struggle with Long In-context Learning" [TMLR2025]
  ☆111Updated 11 months ago