Alternatives and similar repositories for evalchemy

Users that are interested in evalchemy are comparing it to the libraries listed below

• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆331Updated this week
• huggingface / cosmopedia
  ☆561Updated last year
• xfactlab / orpo
  Official repository for ORPO
  ☆469Updated last year
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆621Updated 3 weeks ago
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆683Updated 2 weeks ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆366Updated last year
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,124Updated 8 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆261Updated 9 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆846Updated last month
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆804Updated this week
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆254Updated last year
• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆825Updated 10 months ago
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆484Updated last year
• facebookresearch / swe-rl
  [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆673Updated 10 months ago
• huggingface / Math-Verify
  ☆1,084Updated 3 weeks ago
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆763Updated this week
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆273Updated 3 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆624Updated 6 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆245Updated last year
• facebookresearch / meta-agents-research-environments
  Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…
  ☆418Updated last week
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆740Updated last year
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆750Updated last year
• lmarena / arena-hard-auto
  Arena-Hard-Auto: An automatic LLM benchmark.
  ☆991Updated 7 months ago
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,326Updated 2 weeks ago
• Mohammadjafari80 / GSM8K-RLVR
  A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.
  ☆158Updated 11 months ago
• NovaSky-AI / SkyRL
  SkyRL: A Modular Full-stack RL Library for LLMs
  ☆1,518Updated this week
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆1,061Updated 6 months ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆316Updated 2 years ago
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆321Updated 3 weeks ago
• booydar / babilong
  BABILong is a benchmark for LLM evaluation using the needle-in-a-haystack approach.
  ☆238Updated 5 months ago