floatai / HumanEval-XLLinks
[LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization
☆40Updated 10 months ago
Alternatives and similar repositories for HumanEval-XL
Users that are interested in HumanEval-XL are comparing it to the libraries listed below
Sorting:
- Source codes for paper ”ReACC: A Retrieval-Augmented Code Completion Framework“☆65Updated 3 years ago
- Benchmark ClassEval for class-level code generation.☆145Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆167Updated 5 months ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆67Updated last year
- The repository for paper "DebugBench: "Evaluating Debugging Capability of Large Language Models".☆85Updated last year
- ☆112Updated last year
- ☆15Updated last year
- Code and data for XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence☆90Updated 11 months ago
- ☆47Updated 3 years ago
- Code for the TMLR 2023 paper "PPOCoder: Execution-based Code Generation using Deep Reinforcement Learning"☆118Updated 2 years ago
- A collection of practical code generation tasks and tests in open source projects. Complementary to HumanEval by OpenAI.☆155Updated last year
- ☆33Updated 3 years ago
- XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts☆35Updated last year
- Reinforcement Learning for Repository-Level Code Completion☆42Updated last year
- EvoEval: Evolving Coding Benchmarks via LLM☆80Updated last year
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆163Updated last year
- Adversarial Attack for Pre-trained Code Models☆10Updated 3 years ago
- Artifact repository for the paper "Lost in Translation: A Study of Bugs Introduced by Large Language Models while Translating Code", In P…☆51Updated 9 months ago
- For our ACL25 Paper: Can Language Models Replace Programmers? RepoCod Says ‘Not Yet’ - by Shanchao Liang and Yiran Hu and Nan Jiang and L…☆24Updated 4 months ago
- ☆50Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆184Updated last year
- Baselines for all tasks from Long Code Arena benchmarks 🏟️☆39Updated 9 months ago
- Pip compatible CodeBLEU metric implementation available for linux/macos/win☆128Updated 9 months ago
- ☆33Updated 4 months ago
- Generate the WizardCoder Instruct from the CodeAlpaca☆21Updated 2 years ago
- This is the official implement for the paper 'Domain Adaptive Code Completion via Language Models and Decoupled Domain Databases''☆14Updated 2 years ago
- Enhacing Code Pre-trained Models by Contrastive Learning☆38Updated 2 years ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆263Updated last year
- Releasing code for "ReCode: Robustness Evaluation of Code Generation Models"☆57Updated last year
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆62Updated last year