THUDM / NaturalCodeBenchLinks
NaturalCodeBench (Findings of ACL 2024)
☆65Updated 8 months ago
Alternatives and similar repositories for NaturalCodeBench
Users that are interested in NaturalCodeBench are comparing it to the libraries listed below
Sorting:
- ☆46Updated last year
- ☆47Updated last week
- ☆50Updated last year
- ☆31Updated this week
- ☆41Updated 6 months ago
- ☆82Updated last year
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆68Updated last month
- Collection of papers for scalable automated alignment.☆91Updated 8 months ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆58Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆83Updated 9 months ago
- Towards Systematic Measurement for Long Text Quality☆35Updated 9 months ago
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆63Updated 8 months ago
- ☆68Updated 3 months ago
- On Memorization of Large Language Models in Logical Reasoning☆67Updated 2 months ago
- Lightweight tool to identify Data Contamination in LLMs evaluation☆51Updated last year
- StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback☆65Updated 9 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆50Updated 11 months ago
- ☆35Updated last year
- ☆33Updated 2 weeks ago
- Code for our EMNLP-2023 paper: "Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks"☆24Updated last year
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆55Updated 8 months ago
- 代码大模型 预训练&微调&DPO 数据处理 业界处理pipeline sota☆42Updated 10 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆81Updated 10 months ago
- [ACL 2024 Findings] MathBench: A Comprehensive Multi-Level Difficulty Mathematics Evaluation Dataset☆100Updated last month
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆50Updated 2 weeks ago
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆98Updated last month
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆77Updated 11 months ago
- ☆101Updated 8 months ago
- A Comprehensive Benchmark for Software Development.☆108Updated last year
- ☆63Updated 6 months ago