THUDM / NaturalCodeBenchLinks
NaturalCodeBench (Findings of ACL 2024)
☆67Updated 10 months ago
Alternatives and similar repositories for NaturalCodeBench
Users that are interested in NaturalCodeBench are comparing it to the libraries listed below
Sorting:
- ☆52Updated last year
- ☆83Updated last year
- ☆103Updated 8 months ago
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆62Updated 10 months ago
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆68Updated 11 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆69Updated 3 months ago
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆86Updated 11 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆105Updated 3 months ago
- ☆95Updated 8 months ago
- A Comprehensive Benchmark for Software Development.☆113Updated last year
- Reformatted Alignment☆113Updated 11 months ago
- Counting-Stars (★)☆83Updated 2 months ago
- ☆46Updated 2 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆51Updated 2 months ago
- RL Scaling and Test-Time Scaling (ICML'25)☆111Updated 7 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆81Updated last year
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆91Updated 6 months ago
- ☆50Updated last year
- ☆36Updated last month
- Lightweight tool to identify Data Contamination in LLMs evaluation☆51Updated last year
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆69Updated last week
- Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"☆43Updated 10 months ago
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆108Updated 3 months ago
- [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…☆27Updated last year
- ☆57Updated 9 months ago
- SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis☆97Updated 2 months ago
- ☆109Updated last year
- ☆33Updated 2 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year
- Collection of papers for scalable automated alignment.☆93Updated 10 months ago