Alternatives and similar repositories for NaturalCodeBench:

Users that are interested in NaturalCodeBench are comparing it to the libraries listed below

• CodeEditorBench / CodeEditorBench
  ☆44Updated 11 months ago
• bigcode-project / astraios
  Astraios: Parameter-Efficient Instruction Tuning Code Language Models
  ☆57Updated last year
• SparksofAGI / MHPP
  ☆28Updated 5 months ago
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆48Updated 10 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆34Updated 8 months ago
• thu-coai / SPaR
  ☆47Updated 4 months ago
• Junjie-Ye / ToolEyes
  [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios
  ☆65Updated 5 months ago
• GAIR-NLP / OPO
  ☆49Updated last year
• open-compass / MathBench
  [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset
  ☆98Updated 9 months ago
• THUDM / ChatGLM-Math
  ☆81Updated last year
• AlphaPav / mem-kk-logic
  On Memorization of Large Language Models in Logical Reasoning
  ☆65Updated last month
• zexuanqiu / CLongEval
  CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models
  ☆40Updated last year
• thu-coai / ComplexBench
  Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)
  ☆81Updated 2 months ago
• magicgh / Self-MAP
  [ACL 2024] On the Multi-turn Instruction Following for Conversational Web Agents
  ☆16Updated 6 months ago
• ntunlp / xCodeEval
  xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
  ☆81Updated 7 months ago
• HKUNLP / critic-rl
  Code for Paper: Teaching Language Models to Critique via Reinforcement Learning
  ☆94Updated 3 weeks ago
• thu-coai / CritiqueLLM
  ☆143Updated 10 months ago
• icip-cas / awesome-auto-alignment
  Collection of papers for scalable automated alignment.
  ☆89Updated 6 months ago
• WHGTyen / BIG-Bench-Mistake
  A dataset of LLM-generated chain-of-thought steps annotated with mistake location.
  ☆80Updated 8 months ago
• DIRECT-BIT / SRA-MCTS
  ☆31Updated 5 months ago
• KwanWaiChung / MT-Eval
  Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"
  ☆39Updated 6 months ago
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆47Updated 4 months ago
• LingmaTongyi / Codev-Bench
  Codev-Bench (Code Development Benchmark), a fine-grained, real-world, repository-level, and developer-centric evaluation framework. Codev…
  ☆41Updated 6 months ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆59Updated 7 months ago
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆182Updated 6 months ago
• yegcjs / mixinglaws
  ☆98Updated 7 months ago
• GAIR-NLP / AIME-Preview
  ☆62Updated last month
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences
  ☆71Updated 10 months ago
• TIGER-AI-Lab / MAmmoTH2
  Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]
  ☆139Updated 6 months ago