abacaj / code-evalLinks
Run evaluation on LLMs using human-eval benchmark
☆414Updated last year
Alternatives and similar repositories for code-eval
Users that are interested in code-eval are comparing it to the libraries listed below
Sorting:
- ☆270Updated 2 years ago
- A framework for the evaluation of autoregressive code generation language models.☆949Updated 7 months ago
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆468Updated 4 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆546Updated last year
- Open Source WizardCoder Dataset☆158Updated last year
- Official repository for LongChat and LongEval☆520Updated last year
- ☆310Updated last year
- Fine-tune SantaCoder for Code/Text Generation.☆192Updated 2 years ago
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆306Updated 3 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆463Updated last year
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆640Updated 11 months ago
- LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.☆703Updated 8 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆245Updated 7 months ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆530Updated 4 months ago
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆550Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆166Updated 10 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆379Updated 11 months ago
- Codebase for Merging Language Models (ICML 2024)☆832Updated last year
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆153Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆556Updated 6 months ago
- ☆84Updated 2 years ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆341Updated last year
- ☆541Updated 9 months ago
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆315Updated last year
- Generative Judge for Evaluating Alignment☆239Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆243Updated last year
- Code and data for "Lost in the Middle: How Language Models Use Long Contexts"☆347Updated last year
- Generate textbook-quality synthetic LLM pretraining data☆500Updated last year
- Simple next-token-prediction for RLHF☆227Updated last year
- Code and data for "MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning" [ICLR 2024]☆375Updated 9 months ago