abacaj / code-evalLinks
Run evaluation on LLMs using human-eval benchmark
β421Updated 2 years ago
Alternatives and similar repositories for code-eval
Users that are interested in code-eval are comparing it to the libraries listed below
Sorting:
- π OctoPack: Instruction Tuning Code Large Language Modelsβ471Updated 8 months ago
- Open Source WizardCoder Datasetβ160Updated 2 years ago
- β274Updated 2 years ago
- A framework for the evaluation of autoregressive code generation language models.β985Updated 3 months ago
- β666Updated 11 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.β548Updated last year
- Official repository for LongChat and LongEvalβ531Updated last year
- Fine-tune SantaCoder for Code/Text Generation.β193Updated 2 years ago
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generationβ317Updated 8 months ago
- Accepted by Transactions on Machine Learning Research (TMLR)β132Updated last year
- β371Updated 2 years ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".β256Updated 11 months ago
- β475Updated last year
- β312Updated last year
- PaL: Program-Aided Language Models (ICML 2023)β512Updated 2 years ago
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themβ519Updated last year
- β83Updated 2 years ago
- β¨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024β174Updated last year
- [ICLR 2024] Lemur: Open Foundation Models for Language Agentsβ555Updated last year
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"β470Updated last year
- β544Updated 11 months ago
- A bagel, with everything.β324Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Contextβ477Updated last year
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRavβ¦β316Updated 2 years ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898β227Updated last year
- A hard gym for programmingβ161Updated last year
- Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" [ICLR 2024]β377Updated last year
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"β311Updated last year
- A multi-programming language benchmark for LLMsβ278Updated 2 months ago
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467β296Updated 8 months ago