abacaj / code-evalLinks
Run evaluation on LLMs using human-eval benchmark
☆427Updated 2 years ago
Alternatives and similar repositories for code-eval
Users that are interested in code-eval are comparing it to the libraries listed below
Sorting:
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆479Updated last year
- Open Source WizardCoder Dataset☆163Updated 2 years ago
- ☆279Updated 2 years ago
- A framework for the evaluation of autoregressive code generation language models.☆1,020Updated 6 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆551Updated last year
- Fine-tune SantaCoder for Code/Text Generation.☆196Updated 2 years ago
- Official repository for LongChat and LongEval☆534Updated last year
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆323Updated 11 months ago
- ☆671Updated last year
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆265Updated last year
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆668Updated last year
- PaL: Program-Aided Language Models (ICML 2023)☆517Updated 2 years ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆186Updated last year
- ☆313Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆484Updated last year
- ☆380Updated 2 years ago
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆318Updated 2 years ago
- ☆489Updated last year
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆556Updated 2 years ago
- ☆561Updated last year
- A multi-programming language benchmark for LLMs☆297Updated last week
- ☆85Updated 2 years ago
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆316Updated 2 years ago
- Accepted by Transactions on Machine Learning Research (TMLR)☆137Updated last year
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆546Updated last year
- ☆592Updated last year
- A bagel, with everything.☆326Updated last year
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆389Updated last year
- Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.☆410Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformers☆426Updated 2 years ago