my-other-github-account / llm-humaneval-benchmarksLinks
☆84Updated 2 years ago
Alternatives and similar repositories for llm-humaneval-benchmarks
Users that are interested in llm-humaneval-benchmarks are comparing it to the libraries listed below
Sorting:
- Open Source WizardCoder Dataset☆159Updated 2 years ago
- ☆270Updated 2 years ago
- Run evaluation on LLMs using human-eval benchmark☆415Updated last year
- ☆74Updated last year
- Accepted by Transactions on Machine Learning Research (TMLR)☆129Updated 9 months ago
- Open-source Self-Instruction Tuning Code LLM☆169Updated 2 years ago
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆307Updated 4 months ago
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆469Updated 5 months ago
- ☆172Updated 2 years ago
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆55Updated 8 months ago
- A hard gym for programming☆159Updated last year
- Fine-tune SantaCoder for Code/Text Generation.☆192Updated 2 years ago
- Can It Edit? Evaluating the Ability of Large Language Models to Follow Code Editing Instructions☆44Updated 11 months ago
- SAIL: Search Augmented Instruction Learning☆157Updated 2 years ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆221Updated last year
- CodeUp: A Multilingual Code Generation Llama-X Model with Parameter-Efficient Instruction-Tuning☆126Updated 6 months ago
- This project is an attempt to create a common metric to test LLM's for progress in eliminating hallucinations which is the most serious c…☆222Updated 2 years ago
- evol augment any dataset online☆59Updated last year
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆148Updated 9 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆154Updated last year
- A set of utilities for running few-shot prompting experiments on large-language models☆122Updated last year
- RepoQA: Evaluating Long-Context Code Understanding☆109Updated 8 months ago
- Merge Transformers language models by use of gradient parameters.☆206Updated 11 months ago
- ☆158Updated 10 months ago
- ☆310Updated last year
- Experiments on speculative sampling with Llama models☆128Updated 2 years ago
- ☆95Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆84Updated 9 months ago
- CodeGen2 models for program synthesis☆273Updated 2 years ago
- [FORGE 2025] Graph-based method for end-to-end code completion with context awareness on repository☆63Updated 10 months ago