huggingface / evaluation-guidebookLinks
Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!
☆1,882Updated last month
Alternatives and similar repositories for evaluation-guidebook
Users that are interested in evaluation-guidebook are comparing it to the libraries listed below
Sorting:
- A reading list on LLM based Synthetic Data Generation 🔥☆1,460Updated 5 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,108Updated this week
- Textbook on reinforcement learning from human feedback☆1,295Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,927Updated this week
- Tool for generating high quality Synthetic datasets☆1,379Updated 2 weeks ago
- Synthetic data curation for post-training and structured data extraction☆1,547Updated 3 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,715Updated last week
- Curated list of datasets and tools for post-training.☆3,850Updated 3 months ago
- ☆687Updated 6 months ago
- A collection of notebooks/recipes showcasing usecases of open-source models with Together AI.☆1,071Updated last week
- ☆2,065Updated last week
- Best practices for distilling large language models.☆584Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆411Updated last month
- A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.☆1,568Updated 5 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆1,009Updated 6 months ago
- Bringing BERT into modernity via both architecture changes and scaling☆1,559Updated 4 months ago
- Minimalistic large language model 3D-parallelism training☆2,311Updated 2 months ago
- Fast State-of-the-Art Static Embeddings☆1,898Updated last month
- Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜☆1,776Updated 2 weeks ago
- Fast Semantic Text Deduplication & Filtering☆830Updated 2 weeks ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆822Updated 3 months ago
- Automatically evaluate your LLMs in Google Colab☆664Updated last year
- A 4-hour coding workshop to understand how LLMs are implemented and used☆1,042Updated 10 months ago
- Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs…☆480Updated 11 months ago
- DataDreamer: Prompt. Generate Synthetic Data. Train & Align Models. 🤖💤☆1,077Updated 9 months ago
- Environments for LLM Reinforcement Learning☆3,475Updated this week
- Doing simple retrieval from LLM models at various context lengths to measure accuracy☆2,068Updated last year
- Stanford NLP Python library for Representation Finetuning (ReFT)☆1,526Updated 9 months ago
- ☆1,309Updated 8 months ago
- System 2 Reasoning Link Collection☆855Updated 7 months ago