NaturalCodeBench (Findings of ACL 2024)
☆71Oct 14, 2024Updated 2 years ago
Alternatives and similar repositories for NaturalCodeBench
Users that are interested in NaturalCodeBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆83Apr 18, 2024Updated 2 years ago
- ☆58May 28, 2024Updated 2 years ago
- ☆17Feb 28, 2024Updated 2 years ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆174Oct 11, 2024Updated 2 years ago
- ☆328Aug 18, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆20Apr 9, 2025Updated last year
- ☆47Jun 11, 2025Updated last year
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆184Aug 15, 2025Updated last year
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Dec 22, 2023Updated 2 years ago
- ☆10Nov 14, 2024Updated last year
- A collection of practical code generation tasks and tests from open source projects. Complementary to HumanEval by OpenAI.☆24Jan 28, 2023Updated 3 years ago
- ☆22Jul 16, 2024Updated 2 years ago
- [EACL 2026] The official GitHub repo for the paper "DebateQA: Evaluating Question Answering on Debatable Knowledge"☆11Jan 16, 2026Updated 9 months ago
- Extensive Self-Contrast Enables Feedback-Free Language Model Alignment☆20Apr 2, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆17Jan 27, 2026Updated 9 months ago
- Fork to run instances from SWE-rebench☆31Jun 3, 2026Updated 4 months ago
- Reproducing R1 for Code with Reliable Rewards☆13Apr 9, 2025Updated last year
- ☆14Mar 5, 2025Updated last year
- SWE-Flow: Synthesizing Software Engineering Data in a Test-Driven Manner☆40Jun 29, 2025Updated last year
- ☆12Mar 18, 2024Updated 2 years ago
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆517Jan 3, 2026Updated 9 months ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆72Aug 15, 2024Updated 2 years ago
- Open Source WizardCoder Dataset☆166Jul 12, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official Repo of "CIBench: Evaluation of LLMs as Code Interpreter "☆15Jul 19, 2024Updated 2 years ago
- Code for our TKDE paper "Understanding WeChat User Preferences and “Wow” Diffusion"☆20Aug 29, 2024Updated 2 years ago
- Official github repo for AutoDetect, an automated weakness detection framework for LLMs.☆47Jun 25, 2024Updated 2 years ago
- MNVBC项目裁判文书的清洗代码☆12Sep 11, 2025Updated last year
- Building Open LLM Web Agents with Self-Evolving Online Curriculum RL☆541Jun 6, 2025Updated last year
- This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…☆23May 21, 2025Updated last year
- This repository contains the dataset and code for the ACL 2019 paper "Zero-Shot Semantic Parsing for Instructions" by Ofer Givoli and Roi…☆11Jun 5, 2025Updated last year
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆278Oct 30, 2024Updated 2 years ago
- ☆16Feb 2, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"☆51Oct 31, 2024Updated last year
- ☆60Dec 9, 2022Updated 3 years ago
- ☆12Aug 24, 2026Updated 2 months ago
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆215Aug 16, 2024Updated 2 years ago
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆56May 22, 2025Updated last year
- ⏳ ChatLog: Recording and Analysing ChatGPT Across Time☆105May 30, 2024Updated 2 years ago
- CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings☆75Feb 3, 2025Updated last year