Alternatives and similar repositories for evalchemy:

Users that are interested in evalchemy are comparing it to the libraries listed below

• allenai / olmes
  Reproducible, flexible LLM evaluations
  ☆189Updated 3 weeks ago
• huggingface / cosmopedia
  ☆509Updated 4 months ago
• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆673Updated 3 weeks ago
• tianyi-lab / Reflection_Tuning
  [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning
  ☆354Updated 7 months ago
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,414Updated this week
• huggingface / Math-Verify
  ☆617Updated 2 weeks ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.
  ☆320Updated this week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆553Updated last month
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆713Updated last month
• davanstrien / awesome-synthetic-datasets
  awesome synthetic (text) datasets
  ☆267Updated 5 months ago
• facebookresearch / swe-rl
  Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆495Updated last month
• xfactlab / orpo
  Official repository for ORPO
  ☆447Updated 10 months ago
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆210Updated this week
• FranxYao / Long-Context-Data-Engineering
  Implementation of paper Data Engineering for Scaling Language Models to 128K Context
  ☆457Updated last year
• fanqiwan / FuseAI
  FuseAI Project
  ☆562Updated 2 months ago
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆569Updated 3 months ago
• microsoft / rStar
  ☆513Updated last week
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,051Updated last month
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆430Updated 2 weeks ago
• eddycmu / demystify-long-cot
  ☆278Updated last month
• zhentingqi / rStar
  ☆921Updated 2 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆221Updated 5 months ago
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆800Updated 4 months ago
• JinjieNi / MixEval
  The official evaluation suite and dynamic data release for MixEval.
  ☆234Updated 5 months ago
• cmu-l3 / l1
  L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning
  ☆180Updated 3 weeks ago
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆300Updated last year
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆275Updated this week
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆406Updated 11 months ago
• arcee-ai / EvolKit
  EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…
  ☆210Updated 5 months ago
• trotsky1997 / MathBlackBox
  ☆1,014Updated 4 months ago