mlfoundations / evalchemyLinks
Automatic evals for LLMs
☆399Updated this week
Alternatives and similar repositories for evalchemy
Users that are interested in evalchemy are comparing it to the libraries listed below
Sorting:
- Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆526Updated 2 months ago
- ☆719Updated last month
- RewardBench: the first evaluation tool for reward models.☆582Updated this week
- Reproducible, flexible LLM evaluations☆203Updated 3 weeks ago
- A project to improve skills of large language models☆398Updated last week
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆705Updated 2 months ago
- awesome synthetic (text) datasets☆281Updated 7 months ago
- ☆517Updated 6 months ago
- An Open Source Toolkit For LLM Distillation☆612Updated 3 weeks ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆474Updated 3 weeks ago
- ☆539Updated last month
- Official repository for ORPO☆453Updated last year
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆461Updated last year
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆352Updated 8 months ago
- Official repo for paper: "Reinforcement Learning for Reasoning in Small LLMs: What Works and What Doesn't"☆228Updated 2 weeks ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆220Updated 7 months ago
- SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning☆343Updated last week
- A simple unified framework for evaluating LLMs☆215Updated last month
- The official evaluation suite and dynamic data release for MixEval.☆241Updated 6 months ago
- Code for Quiet-STaR☆732Updated 9 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆367Updated last week
- LOFT: A 1 Million+ Token Long-Context Benchmark☆198Updated last month
- ☆292Updated 2 months ago
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆725Updated 8 months ago
- Tina: Tiny Reasoning Models via LoRA☆234Updated 2 weeks ago
- Recipes to scale inference-time compute of open models☆1,073Updated last week
- Large Reasoning Models☆804Updated 5 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆764Updated 2 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,563Updated last week
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆201Updated 3 weeks ago