Alternatives and similar repositories for arena-hard-auto:

Users that are interested in arena-hard-auto are comparing it to the libraries listed below

• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,044Updated last month
• zhentingqi / rStar
  ☆910Updated 2 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆721Updated 7 months ago
• magpie-align / magpie
  [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …
  ☆660Updated last week
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆340Updated this week
• huggingface / cosmopedia
  ☆502Updated 4 months ago
• trotsky1997 / MathBlackBox
  ☆1,011Updated 3 months ago
• Open-Source-O1 / Open-O1
  ☆1,347Updated 4 months ago
• wasiahmad / Awesome-LLM-Synthetic-Data
  A reading list on LLM based Synthetic Data Generation 🔥
  ☆1,211Updated last month
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,313Updated this week
• arcee-ai / DistillKit
  An Open Source Toolkit For LLM Distillation
  ☆544Updated 2 months ago
• Leeroo-AI / mergoo
  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.
  ☆454Updated 6 months ago
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆799Updated 3 months ago
• LiveCodeBench / LiveCodeBench
  Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
  ☆385Updated last month
• AIDC-AI / Marco-o1
  An Open Large Reasoning Model for Real-World Solutions
  ☆1,475Updated 3 weeks ago
• willccbb / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆686Updated this week
• bespokelabsai / curator
  Synthetic data curation for post-training and structured data extraction
  ☆1,065Updated this week
• lm-sys / llm-decontaminator
  Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"
  ☆298Updated last year
• WildEval / ZeroEval
  A simple unified framework for evaluating LLMs
  ☆206Updated 2 weeks ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym
  ☆402Updated 2 weeks ago
• argilla-io / distilabel
  Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…
  ☆2,578Updated this week
• microsoft / rStar
  ☆485Updated this week
• fanqiwan / FuseAI
  FuseAI Project
  ☆547Updated 2 months ago
• huggingface / Math-Verify
  ☆559Updated last week
• facebookresearch / swe-rl
  Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆474Updated last week
• SqueezeAILab / TinyAgent
  [EMNLP 2024 Demo] TinyAgent: Function Calling at the Edge!
  ☆377Updated 6 months ago
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆998Updated 2 months ago
• allenai / WildBench
  Benchmarking LLMs with Challenging Tasks from Real Users
  ☆219Updated 4 months ago
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆705Updated 5 months ago
• GAIR-NLP / LIMO
  LIMO: Less is More for Reasoning
  ☆864Updated last month