Alternatives and similar repositories for evalchemy

Users that are interested in evalchemy are comparing it to the libraries listed below

• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆713Updated 3 months ago
• xfactlab / orpo
  Official repository for ORPO
  ☆455Updated last year
• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆213Updated last month
• huggingface / Math-Verify
  ☆773Updated last month
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆379Updated last week
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,629Updated this week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆604Updated last week
• huggingface / cosmopedia
  ☆520Updated 7 months ago
• NovaSky-AI / SkyRL
  SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning
  ☆410Updated last week
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆217Updated 2 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,095Updated 3 weeks ago
• facebookresearch / swe-rl
  Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆545Updated 3 months ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆357Updated 9 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆242Updated 7 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆651Updated 2 weeks ago
• huggingface / yourbench
  🤗 Benchmark Large Language Models Reliably On Your Data
  ☆329Updated this week
• google-deepmind / loft
  LOFT: A 1 Million+ Token Long-Context Benchmark
  ☆201Updated last week
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆282Updated 7 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆486Updated last month
• microsoft / rStar
  ☆569Updated 2 months ago
• eddycmu / demystify-long-cot
  ☆297Updated 3 weeks ago
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆234Updated this week
• zhentingqi / rStar
  ☆938Updated 4 months ago
• bespokelabsai / curator
  Synthetic data curation for post-training and structured data extraction
  ☆1,404Updated this week
• knoveleng / open-rs
  Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"
  ☆236Updated last month
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆258Updated 3 weeks ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆224Updated 7 months ago
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆423Updated this week
• Agent-RL / ReCall
  ReCall: Learning to Reason with Tool Call for LLMs via Reinforcement Learning
  ☆936Updated last month
• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆814Updated 3 weeks ago