NaturalCodeBench (Findings of ACL 2024)
☆70Oct 14, 2024Updated last year
Alternatives and similar repositories for NaturalCodeBench
Users that are interested in NaturalCodeBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆82Apr 18, 2024Updated 2 years ago
- CRUXEval: Code Reasoning, Understanding, and Execution Evaluation☆173Oct 11, 2024Updated last year
- ☆17Feb 28, 2024Updated 2 years ago
- ☆58May 28, 2024Updated 2 years ago
- ☆325Aug 18, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Apr 9, 2025Updated last year
- Extensive Self-Contrast Enables Feedback-Free Language Model Alignment☆20Apr 2, 2024Updated 2 years ago
- ☆22Jul 16, 2024Updated 2 years ago
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Dec 22, 2023Updated 2 years ago
- ☆13Mar 5, 2025Updated last year
- A collection of practical code generation tasks and tests from open source projects. Complementary to HumanEval by OpenAI.☆24Jan 28, 2023Updated 3 years ago
- Deep-dive notes and source code analysis of Claude Code and AI agent harnesses. Exploring memory mechanics and internal architectures.☆24Apr 3, 2026Updated 4 months ago
- Reproducing R1 for Code with Reliable Rewards☆13Apr 9, 2025Updated last year
- ☆17Jan 27, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Fork to run instances from SWE-rebench☆31Jun 3, 2026Updated 2 months ago
- CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)☆181Aug 15, 2025Updated 11 months ago
- Repository containing the website for the EMNLP 2023 conference☆17Feb 12, 2025Updated last year
- Scaling Agentic Reinforcement Learning with a Multi-Turn, Multi-Task Framework☆337Jan 17, 2026Updated 6 months ago
- An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories☆71Aug 15, 2024Updated last year
- This repository presents the original implementation of Pretraining Data Detection for Large Language Models: A Divergence-based Calibrat…☆23May 21, 2025Updated last year
- ☆18Mar 28, 2026Updated 4 months ago
- Arxiv地址：https://arxiv.org/abs/2409.01944☆23Feb 20, 2025Updated last year
- A collection of papers tackling automatic fact-checking (particularly of AI-generated content)☆13Nov 3, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings☆74Feb 3, 2025Updated last year
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆93Nov 4, 2023Updated 2 years ago
- Building Open LLM Web Agents with Self-Evolving Online Curriculum RL☆537Jun 6, 2025Updated last year
- ☆48Dec 12, 2024Updated last year
- The official implementation of "Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks"☆56May 22, 2025Updated last year
- [ICML 2023] Data and code release for the paper "DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation".☆276Oct 30, 2024Updated last year
- ☆158Aug 27, 2024Updated last year
- ✨ RepoBench: Benchmarking Repository-Level Code Auto-Completion Systems - ICLR 2024☆214Aug 16, 2024Updated last year
- ☆50Sep 6, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆10May 25, 2017Updated 9 years ago
- A modified Alphazero implementation with C++ where performance matters.☆21Jul 28, 2026Updated last week
- Benchmarking Language Agents Under Controllable and Extreme Context Growth☆51Apr 29, 2026Updated 3 months ago
- Collection of papers for scalable automated alignment.☆92Oct 22, 2024Updated last year
- [ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI☆519Jan 3, 2026Updated 7 months ago
- Code for paper: "Executing Arithmetic: Fine-Tuning Large Language Models as Turing Machines"☆11Oct 11, 2024Updated last year
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆89Aug 10, 2024Updated 2 years ago