my-other-github-account / llm-humaneval-benchmarks
☆84Updated last year
Alternatives and similar repositories for llm-humaneval-benchmarks:
Users that are interested in llm-humaneval-benchmarks are comparing it to the libraries listed below
- ☆73Updated last year
- Open Source WizardCoder Dataset☆158Updated last year
- ☆270Updated 2 years ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆136Updated 7 months ago
- Accepted by Transactions on Machine Learning Research (TMLR)☆126Updated 7 months ago
- Experiments on speculative sampling with Llama models☆126Updated last year
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆463Updated 3 months ago
- evol augment any dataset online☆59Updated last year
- ☆179Updated 2 years ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆162Updated 8 months ago
- Run evaluation on LLMs using human-eval benchmark☆411Updated last year
- Open-source Self-Instruction Tuning Code LLM☆170Updated 2 years ago
- A distributed, extensible, secure solution for evaluating machine generated code with unit tests in multiple programming languages.☆53Updated 6 months ago
- ☆173Updated last year
- The data processing pipeline for the Koala chatbot language model☆117Updated 2 years ago
- Official implementation for 'Extending LLMs’ Context Window with 100 Samples'☆77Updated last year
- Fine-tune SantaCoder for Code/Text Generation.☆192Updated 2 years ago
- ☆75Updated last month
- RepoQA: Evaluating Long-Context Code Understanding☆108Updated 6 months ago
- A set of utilities for running few-shot prompting experiments on large-language models☆120Updated last year
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆217Updated last year
- xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval☆81Updated 7 months ago
- ☆155Updated 8 months ago
- A hard gym for programming☆153Updated 10 months ago
- This project is an attempt to create a common metric to test LLM's for progress in eliminating hallucinations which is the most serious c…☆222Updated 2 years ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆140Updated 9 months ago
- Code repository for the c-BTM paper☆106Updated last year
- QLoRA: Efficient Finetuning of Quantized LLMs☆78Updated last year
- ☆94Updated last year
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆307Updated 2 months ago