my-other-github-account / llm-humaneval-benchmarks
☆84Updated last year
Alternatives and similar repositories for llm-humaneval-benchmarks:
Users that are interested in llm-humaneval-benchmarks are comparing it to the libraries listed below
- Open Source WizardCoder Dataset☆157Updated last year
- ☆73Updated last year
- ☆268Updated last year
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆212Updated 11 months ago
- evol augment any dataset online☆59Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆136Updated 8 months ago
- Accepted by Transactions on Machine Learning Research (TMLR)☆126Updated 6 months ago
- Fine-tune SantaCoder for Code/Text Generation.☆191Updated 2 years ago
- ☆172Updated last year
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆135Updated 6 months ago
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆52Updated 5 months ago
- ☆44Updated 10 months ago
- Experiments on speculative sampling with Llama models☆125Updated last year
- Run evaluation on LLMs using human-eval benchmark☆404Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆152Updated 8 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆150Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆79Updated 6 months ago
- Code for paper "LEVER: Learning to Verifiy Language-to-Code Generation with Execution" (ICML'23)☆85Updated last year
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆240Updated 5 months ago
- A hard gym for programming☆152Updated 9 months ago
- Repository for analysis and experiments in the BigCode project.☆117Updated last year
- ☆121Updated 10 months ago
- ☆75Updated 3 weeks ago
- SAIL: Search Augmented Instruction Learning☆157Updated last year
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆462Updated 2 months ago
- The data processing pipeline for the Koala chatbot language model☆117Updated 2 years ago
- RepoQA: Evaluating Long-Context Code Understanding☆107Updated 5 months ago
- A set of utilities for running few-shot prompting experiments on large-language models☆118Updated last year
- Enhancing AI Software Engineering with Repository-level Code Graph☆151Updated 2 weeks ago
- Code repository for the c-BTM paper☆106Updated last year