JohnnyPeng18 / APIBench
APIBench is a benchmark for evaluating the performance of API recommendation approaches released in the paper "Revisiting, Benchmarking and Exploring APIRecommendation: How Far Are We?".
☆48Updated last year
Related projects: ⓘ
- ☆111Updated last year
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆38Updated last month
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆52Updated 2 months ago
- Large Language Models Meet NL2Code: A Survey☆35Updated 2 months ago
- ☆48Updated 3 months ago
- ☆39Updated 3 months ago
- Repo-Level Code generation papers☆66Updated 3 months ago
- Repoformer: Selective Retrieval for Repository-Level Code Completion (ICML 2024)☆33Updated 2 months ago
- Source codes for paper ”ReACC: A Retrieval-Augmented Code Completion Framework“☆55Updated 2 years ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆211Updated last month
- CodeRAG-Bench: Can Retrieval Augment Code Generation?☆54Updated 2 months ago
- Official implementation of paper How to Understand Whole Repository? New SOTA on SWE-bench Lite (21.3%)☆55Updated 3 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆114Updated last month
- Code and data for XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence☆63Updated last year
- Source code for paper: INTERVENOR : Prompt the Coding Ability of Large Language Models with the Interactive Chain of Repairing☆23Updated 3 months ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆129Updated last month
- ☆52Updated 2 months ago
- Code for the TMLR 2023 paper "PPOCoder: Execution-based Code Generation using Deep Reinforcement Learning"☆94Updated 8 months ago
- ☆45Updated 2 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆76Updated last year
- [EACL 2024] ICE-Score: Instructing Large Language Models to Evaluate Code☆67Updated 3 months ago
- ☆27Updated last year
- ☆25Updated last week
- [LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization☆25Updated this week
- Enhancing AI Software Engineering with Repository-level Code Graph☆60Updated 3 weeks ago
- ☆40Updated 3 weeks ago
- ☆17Updated 3 months ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆99Updated last month
- InstructCoder (former name:Codelnstruct) enables LLMs to edit code☆47Updated 6 months ago
- Evaluating the Factuality of Large Language Models using Large-Scale Knowledge Graphs☆19Updated 2 weeks ago