openai / simple-evalsLinks
☆4,340Updated 6 months ago
Alternatives and similar repositories for simple-evals
Users that are interested in simple-evals are comparing it to the libraries listed below
Sorting:
- AllenAI's post-training codebase☆3,562Updated this week
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆2,167Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆3,084Updated 2 weeks ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,291Updated 2 weeks ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆1,301Updated 3 weeks ago
- PyTorch native post-training library☆5,660Updated last week
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆3,341Updated 6 months ago
- Democratizing Reinforcement Learning for LLMs☆5,081Updated this week
- Arena-Hard-Auto: An automatic LLM benchmark.☆994Updated 7 months ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,940Updated 6 months ago
- [ICLR 2025] Automated Design of Agentic Systems☆1,506Updated last year
- A library for advanced large language model reasoning☆2,328Updated 8 months ago
- Tools for merging pretrained large language models.☆6,761Updated 2 weeks ago
- ☆3,071Updated 2 months ago
- [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…☆5,823Updated 3 months ago
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,662Updated this week
- Our library for RL environments + evals☆3,809Updated this week
- ☆1,346Updated last year
- Modeling, training, eval, and inference code for OLMo☆6,305Updated 2 months ago
- DataComp for Language Models☆1,413Updated 5 months ago
- MTEB: Massive Text Embedding Benchmark☆3,106Updated this week
- An Open Large Reasoning Model for Real-World Solutions☆1,533Updated this week
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆1,460Updated 11 months ago
- Fully open data curation for reasoning models☆2,206Updated 2 months ago
- Robust recipes to align language models with human and AI preferences☆5,489Updated 5 months ago
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆4,232Updated last week
- Code and Data for Tau-Bench☆1,087Updated 5 months ago
- Minimalistic large language model 3D-parallelism training☆2,544Updated last month
- ☆2,577Updated this week
- ☆4,112Updated last year