Alternatives and similar repositories for RACE

Users that are interested in RACE are comparing it to the libraries listed below

• CodeLLM-Research / CodeJudge-Eval
  [COLING25] CodeJudge Eval: Can Large Language Models be Good Judges in Code Understanding?
  ☆13Updated last year
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆53Updated 7 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• banksy23 / XCoder
  ☆36Updated 6 months ago
• Spico197 / awesome-lm-evaluation
  🩺 A collection of ChatGPT evaluation reports on various bechmarks.
  ☆50Updated 2 years ago
• ChengpengLi1003 / DotaMath
  ☆30Updated last year
• yuh-zha / Align
  Align, a general text alignment function
  ☆15Updated 2 years ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• yiqingxyq / RepoST
  Code for "[COLM'25] RepoST: Scalable Repository-Level Coding Environment Construction with Sandbox Testing"
  ☆22Updated 10 months ago
• microsoft / text-to-sql-schema-expansion-generalization
  Bridging the Generalization Gap in Text-to-SQL Parsing with Schema Expansion
  ☆14Updated 2 years ago
• dqxiu / KAssess
  ☆14Updated 2 years ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆64Updated last year
• nlp-uoregon / ullme
  ☆20Updated 9 months ago
• crux-eval / eval-arena
  ☆32Updated this week
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• RUCAIBox / BAMBOO
  ☆35Updated last year
• THU-KEG / VerIF
  [EMNLP 2025] Verification Engineering for RL in Instruction Following
  ☆50Updated 3 weeks ago
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆59Updated last year
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆29Updated last year
• Strong-AI-Lab / Logical-and-abstract-reasoning
  Evaluation on Logical Reasoning and Abstract Reasoning Challenges
  ☆29Updated 9 months ago
• SWE-Perf / SWE-Perf
  ☆46Updated 3 months ago
• Spico197 / MoE-SFT
  🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts
  ☆41Updated last year
• TingchenFu / MathIF
  instruction-following benchmark for large reasoning models
  ☆44Updated 5 months ago
• RenzeLou / Muffin
  MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following
  ☆16Updated last year
• Yifan-Song793 / GoodBadGreedy
  The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism
  ☆30Updated last year
• zorazrw / odex
  [EMNLP'23] Execution-Based Evaluation for Open Domain Code Generation
  ☆49Updated 2 years ago
• ChiyuSONG / dynamics-of-instruction-tuning
  ☆17Updated 10 months ago
• LuLuLuyi / LongHeads
  [EMNLP'24] LongHeads: Multi-Head Attention is Secretly a Long Context Processor
  ☆31Updated last year
• WadeYin9712 / Dynosaur
  Code and data for "Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation" (EMNLP 2023)
  ☆64Updated 2 years ago