jszheng21 / RACELinks
RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.
☆11Updated last year
Alternatives and similar repositories for RACE
Users that are interested in RACE are comparing it to the libraries listed below
Sorting:
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆51Updated 6 months ago
- Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"☆22Updated 9 months ago
- ☆30Updated last year
- ☆30Updated this week
- Source code of "Reasons to Reject? Aligning Language Models with Judgments"☆58Updated last year
- Evaluate the Quality of Critique☆36Updated last year
- ☆35Updated last year
- [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning☆28Updated last year
- Align, a general text alignment function☆15Updated 2 years ago
- ☆36Updated 5 months ago
- Contrastive Chain-of-Thought Prompting☆68Updated 2 years ago
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Updated 2 years ago
- Official implementation of the ACL Findings 2023 paper: Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarizatio…☆14Updated last year
- Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)☆27Updated 2 months ago
- ☆20Updated 8 months ago
- ☆14Updated 2 years ago
- [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆31Updated last year
- [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"☆78Updated last year
- 🩺 A collection of ChatGPT evaluation reports on various bechmarks.☆50Updated 2 years ago
- Benchmarking Benchmark Leakage in Large Language Models☆58Updated last year
- [EMNLP 2025] Verification Engineering for RL in Instruction Following☆45Updated 2 months ago
- The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism☆30Updated last year
- ☆17Updated 9 months ago
- ☆58Updated last year
- QRHead: Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking☆32Updated 3 weeks ago
- Lightweight tool to identify Data Contamination in LLMs evaluation☆53Updated last year
- [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation☆49Updated 2 years ago
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆118Updated 7 months ago
- [NAACL 2024] Making Language Models Better Tool Learners with Execution Feedback☆42Updated last year
- Evaluation on Logical Reasoning and Abstract Reasoning Challenges☆29Updated 8 months ago