Alternatives and similar repositories for infibench-evaluator:

Users that are interested in infibench-evaluator are comparing it to the libraries listed below

• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆33Updated 4 months ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆58Updated 5 months ago
• ise-uiuc / xft
  XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts
  ☆30Updated 8 months ago
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated 11 months ago
• Ablustrund / APPS_Plus
  StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback
  ☆64Updated 6 months ago
• crux-eval / eval-arena
  ☆22Updated 4 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• dashends / CodeSyntax
  Code and dataset for EMNLP 2022 Findings paper "Benchmarking Language Models for Code Syntax Understanding"
  ☆14Updated 2 years ago
• facebookresearch / cruxeval
  CRUXEval: Code Reasoning, Understanding, and Execution Evaluation
  ☆133Updated 5 months ago
• niansong1996 / lever
  Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)
  ☆85Updated last year
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• SalesforceAIResearch / swecomm
  ☆26Updated 2 months ago
• ScalingIntelligence / large_language_monkeys
  ☆87Updated 6 months ago
• nyu-mll / ILF-for-code-generation
  ☆74Updated last year
• HumanEval-V / HumanEval-V-Benchmark
  A Lightweight Visual Reasoning Benchmark for Evaluating Large Multimodal Models through Complex Diagrams in Coding Tasks
  ☆6Updated last month
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences
  ☆70Updated 9 months ago
• logic-star-ai / swt-bench
  [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation
  ☆36Updated last week
• GeniusHTX / TALE
  ☆76Updated this week
• evalplus / repoqa
  RepoQA: Evaluating Long-Context Code Understanding
  ☆106Updated 4 months ago
• InternLM / SWE-Fixer
  ☆80Updated last month
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆47Updated last year
• gonglinyuan / ast_t5
  ☆59Updated 10 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆40Updated 2 weeks ago
• VITA-Group / o1-planning
  On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
  ☆38Updated 2 months ago
• katiekang1998 / reasoning_generalization
  ☆30Updated 2 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated 11 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆59Updated 5 months ago
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆45Updated 8 months ago
• rmshin / llm-mcts
  ☆36Updated 9 months ago
• ScalerLab / JudgeBench
  ☆65Updated 4 months ago