abacaj / code-eval
Run evaluation on LLMs using human-eval benchmark
☆380Updated last year
Related projects ⓘ
Alternatives and complementary repositories for code-eval
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆528Updated 8 months ago
- ☆260Updated last year
- Open Source WizardCoder Dataset☆153Updated last year
- 🐙 OctoPack: Instruction Tuning Code Large Language Models☆433Updated last month
- Fine-tune SantaCoder for Code/Text Generation.☆186Updated last year
- [ICLR 2024] Lemur: Open Foundation Models for Language Agents☆535Updated last year
- Official repository for LongChat and LongEval☆512Updated 5 months ago
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆221Updated last week
- NexusRaven-13B, a new SOTA Open-Source LLM for function calling. This repo contains everything for reproducing our evaluation on NexusRav…☆306Updated last year
- LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.☆613Updated last month
- A bagel, with everything.☆312Updated 6 months ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆200Updated last month
- A framework for the evaluation of autoregressive code generation language models.☆811Updated last week
- [NeurIPS'24] SelfCodeAlign: Self-Alignment for Code Generation☆259Updated last week
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆211Updated last year
- ☆294Updated 5 months ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆463Updated last month
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆610Updated 5 months ago
- [NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898☆194Updated 6 months ago
- Chain-of-Hindsight, A Scalable RLHF Method☆218Updated last year
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆233Updated 6 months ago
- ☆445Updated last week
- ☆605Updated last week
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆133Updated 2 months ago
- Official codebase for "SelFee: Iterative Self-Revising LLM Empowered by Self-Feedback Generation"☆220Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆881Updated 2 weeks ago
- Build Hierarchical Autonomous Agents through Config. Collaborative Growth of Specialized Agents.☆297Updated 11 months ago
- Mass-editing thousands of facts into a transformer memory (ICLR 2023)☆434Updated 9 months ago
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆586Updated 3 months ago
- Generative Judge for Evaluating Alignment☆216Updated 9 months ago