lmarena / arena-hard-autoLinks
Arena-Hard-Auto: An automatic LLM benchmark.
☆892Updated last month
Alternatives and similar repositories for arena-hard-auto
Users that are interested in arena-hard-auto are comparing it to the libraries listed below
Sorting:
- ☆529Updated 8 months ago
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆745Updated 4 months ago
- Code for Quiet-STaR☆737Updated 11 months ago
- Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"☆616Updated 3 weeks ago
- Automatic evals for LLMs☆509Updated last month
- ☆1,028Updated 7 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆830Updated 4 months ago
- ☆1,355Updated 8 months ago
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆913Updated 5 months ago
- An Open Source Toolkit For LLM Distillation☆703Updated last month
- ☆955Updated 6 months ago
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆739Updated 10 months ago
- ☆879Updated last month
- Large Reasoning Models☆804Updated 8 months ago
- Recipes to scale inference-time compute of open models☆1,112Updated 2 months ago
- Official repository for ORPO☆462Updated last year
- RewardBench: the first evaluation tool for reward models.☆622Updated last month
- FuseAI Project☆579Updated 6 months ago
- A project to improve skills of large language models☆507Updated this week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,811Updated this week
- An Open Large Reasoning Model for Real-World Solutions☆1,512Updated 2 months ago
- LiveBench: A Challenging, Contamination-Free LLM Benchmark☆847Updated this week
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆1,279Updated 5 months ago
- [COLM 2025] LIMO: Less is More for Reasoning☆1,000Updated last week
- Scalable toolkit for efficient model alignment☆834Updated last week
- [ICML'24 Spotlight] LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning☆660Updated last year
- ☆611Updated 3 weeks ago
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆1,964Updated 11 months ago
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆388Updated 10 months ago
- This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?☆1,229Updated 3 weeks ago