abacaj / code-evalLinks
Run evaluation on LLMs using human-eval benchmark
β419Updated last year
Alternatives and similar repositories for code-eval
Users that are interested in code-eval are comparing it to the libraries listed below
Sorting:
- π OctoPack: Instruction Tuning Code Large Language Modelsβ470Updated 6 months ago
- Open Source WizardCoder Datasetβ160Updated 2 years ago
- β271Updated 2 years ago
- β663Updated 9 months ago
- A framework for the evaluation of autoregressive code generation language models.β975Updated last month
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.β547Updated last year
- Fine-tune SantaCoder for Code/Text Generation.β192Updated 2 years ago
- Official repository for LongChat and LongEvalβ527Updated last year
- β¨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024β170Updated last year
- β84Updated 2 years ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".β252Updated 9 months ago
- β311Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Contextβ470Updated last year
- PaL: Program-Aided Language Models (ICML 2023)β503Updated 2 years ago
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuningβ661Updated last year
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRavβ¦β316Updated last year
- β367Updated 2 years ago
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generationβ309Updated 5 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmarkβ389Updated last year
- [ICLR 2024] Lemur: Open Foundation Models for Language Agentsβ555Updated last year
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898β223Updated last year
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"β630Updated last month
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467β290Updated 6 months ago
- A multi-programming language benchmark for LLMsβ268Updated 2 weeks ago
- Accepted by Transactions on Machine Learning Research (TMLR)β130Updated 10 months ago
- Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" [ICLR 2024]β376Updated 11 months ago
- β472Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"β308Updated last year
- Landmark Attention: Random-Access Infinite Context Length for Transformersβ423Updated last year
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themβ507Updated last year