openai / simple-evalsLinks
☆4,044Updated last month
Alternatives and similar repositories for simple-evals
Users that are interested in simple-evals are comparing it to the libraries listed below
Sorting:
- AllenAI's post-training codebase☆3,180Updated this week
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆2,020Updated last year
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,878Updated last week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,890Updated this week
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,851Updated last month
- Democratizing Reinforcement Learning for LLMs☆4,144Updated last week
- ☆2,335Updated 2 weeks ago
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,470Updated this week
- A unified evaluation framework for large language models☆2,711Updated last month
- DataComp for Language Models☆1,367Updated last week
- A library for advanced large language model reasoning☆2,273Updated 3 months ago
- PyTorch native post-training library☆5,484Updated this week
- Robust recipes to align language models with human and AI preferences☆5,356Updated last week
- Measuring Massive Multitask Language Understanding | ICLR 2021☆1,493Updated 2 years ago
- ☆2,530Updated last year
- Tools for merging pretrained large language models.☆6,275Updated last month
- TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients. Published in Nature.☆2,919Updated last month
- Sky-T1: Train your own O1 preview model within $450☆3,327Updated 2 months ago
- SWE-bench: Can Language Models Resolve Real-world Github Issues?☆3,486Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,616Updated 3 weeks ago
- MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering☆957Updated this week
- Official repo for the paper "Scaling Synthetic Data Creation with 1,000,000,000 Personas"☆1,318Updated 6 months ago
- ☆4,092Updated last year
- 800,000 step-level correctness labels on LLM solutions to MATH problems☆2,045Updated 2 years ago
- Verifiers for LLM Reinforcement Learning☆2,981Updated last week
- ☆1,353Updated 9 months ago
- Synthetic data curation for post-training and structured data extraction☆1,495Updated last month
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆3,141Updated 2 weeks ago
- [ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling☆1,751Updated last year
- Stanford NLP Python library for Representation Finetuning (ReFT)☆1,512Updated 7 months ago