THUDM / NaturalCodeBenchLinks
NaturalCodeBench (Findings of ACL 2024)
☆67Updated 11 months ago
Alternatives and similar repositories for NaturalCodeBench
Users that are interested in NaturalCodeBench are comparing it to the libraries listed below
Sorting:
- ☆53Updated last year
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆62Updated last year
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆70Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆86Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆69Updated 4 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆51Updated 3 months ago
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆56Updated 11 months ago
- ☆83Updated last year
- ☆32Updated 2 weeks ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆153Updated 11 months ago
- A Comprehensive Benchmark for Software Development.☆113Updated last year
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆131Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆94Updated 7 months ago
- ☆44Updated 9 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆157Updated last month
- ☆34Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆82Updated last year
- Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"☆42Updated 11 months ago
- ☆51Updated last year
- Collection of papers for scalable automated alignment.☆93Updated 11 months ago
- ☆33Updated 3 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆161Updated last year
- Towards Systematic Measurement for Long Text Quality☆37Updated last year
- ☆46Updated 3 months ago
- ☆28Updated last year
- The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…☆52Updated 10 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆106Updated 4 months ago
- Counting-Stars (★)☆83Updated 3 months ago
- [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback☆42Updated last year
- CodeUltraFeedback: aligning large language models to coding preferences (TOSEM 2025)☆71Updated last year