abacaj / code-eval
Run evaluation on LLMs using human-eval benchmark
☆406Updated last year
Alternatives and similar repositories for code-eval:
Users that are interested in code-eval are comparing it to the libraries listed below
- Open Source WizardCoder Dataset☆157Updated last year
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆462Updated 2 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆240Updated 5 months ago
- ☆268Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆544Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆156Updated 8 months ago
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆315Updated last year
- Official repository for LongChat and LongEval☆518Updated 10 months ago
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆304Updated last month
- A framework for the evaluation of autoregressive code generation language models.☆930Updated 5 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆136Updated 8 months ago
- ☆308Updated 10 months ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆517Updated 2 months ago
- Fine-tune SantaCoder for Code/Text Generation.☆191Updated 2 years ago
- Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" (ICLR 2024)☆368Updated 7 months ago
- Generative Judge for Evaluating Alignment☆235Updated last year
- A bagel, with everything.☆318Updated last year
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆470Updated 7 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆375Updated 9 months ago
- ☆84Updated last year
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆211Updated 11 months ago
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆546Updated 4 months ago
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆626Updated 8 months ago
- ☆314Updated 7 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆458Updated last year
- Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.☆368Updated last year
- Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718☆317Updated 6 months ago
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆463Updated last year
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆650Updated 10 months ago
- ☆526Updated 7 months ago