THUDM / NaturalCodeBenchLinks
NaturalCodeBench (Findings of ACL 2024)
☆69Updated last year
Alternatives and similar repositories for NaturalCodeBench
Users that are interested in NaturalCodeBench are comparing it to the libraries listed below
Sorting:
- ☆56Updated last year
- ☆83Updated last year
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆64Updated last year
- ☆51Updated last year
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆74Updated last year
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆108Updated 7 months ago
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆87Updated last year
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆62Updated last year
- Reformatted Alignment☆111Updated last year
- ☆45Updated last year
- A Comprehensive Benchmark for Software Development.☆124Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆73Updated 8 months ago
- On Memorization of Large Language Models in Logical Reasoning☆72Updated 9 months ago
- Collection of papers for scalable automated alignment.☆93Updated last year
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆107Updated 10 months ago
- [ICLR 2024] Evaluating Large Language Models at Evaluating Instruction Following☆134Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆99Updated 10 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year
- Counting-Stars (★)☆83Updated last month
- ☆80Updated 10 months ago
- ☆104Updated last year
- ☆46Updated 7 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆85Updated last year
- ☆32Updated 7 months ago
- ☆33Updated 4 months ago
- ☆147Updated last year
- [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…☆68Updated last year
- Lightweight tool to identify Data Contamination in LLMs evaluation☆53Updated last year
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆164Updated last year
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆111Updated 3 months ago