THUDM / NaturalCodeBench
NaturalCodeBench (Findings of ACL 2024)
☆62Updated 5 months ago
Alternatives and similar repositories for NaturalCodeBench:
Users that are interested in NaturalCodeBench are comparing it to the libraries listed below
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆50Updated 4 months ago
- ☆28Updated 4 months ago
- ☆45Updated 9 months ago
- ☆81Updated 10 months ago
- [COLING 2025] ToolEyes: Fine-Grained Evaluation for Tool Learning Capabilities of Large Language Models in Real-world Scenarios☆66Updated 3 months ago
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆46Updated 8 months ago
- ☆35Updated 3 months ago
- ☆48Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆78Updated 5 months ago
- ☆42Updated 2 months ago
- Astraios: Parameter-Efficient Instruction Tuning Code Language Models☆57Updated 11 months ago
- ☆28Updated 3 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆44Updated 2 months ago
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆66Updated 8 months ago
- Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"☆51Updated 9 months ago
- The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…☆45Updated 4 months ago
- Towards Systematic Measurement for Long Text Quality☆32Updated 6 months ago
- Hammer: Robust Function-Calling for On-Device Language Models via Function Masking☆62Updated 3 weeks ago
- Self-Knowledge Guided Retrieval Augmentation for Large Language Models (EMNLP Findings 2023)☆25Updated last year
- Collection of papers for scalable automated alignment.☆85Updated 4 months ago
- 代码大模型 预训练&微调&DPO 数据处理 业界处理pipeline sota☆33Updated 7 months ago
- CLongEval: A Chinese Benchmark for Evaluating Long-Context Large Language Models☆40Updated last year
- InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw☆58Updated 5 months ago
- Code and data for the paper "Can Large Language Models Understand Real-World Complex Instructions?"(AAAI2024)☆47Updated 10 months ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆41Updated 8 months ago
- ☆96Updated 5 months ago
- [NeurIPS 2024] OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI☆96Updated last week
- Reformatted Alignment☆114Updated 5 months ago
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year