predibase / llm_distillation_playbook
Best practices for distilling large language models.
☆511Updated last year
Alternatives and similar repositories for llm_distillation_playbook:
Users that are interested in llm_distillation_playbook are comparing it to the libraries listed below
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,358Updated last week
- An Open Source Toolkit For LLM Distillation☆562Updated 2 months ago
- ☆504Updated 4 months ago
- Easily embed, cluster and semantically label text datasets☆520Updated last year
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,105Updated 2 months ago
- Generative Representational Instruction Tuning☆613Updated 2 weeks ago
- A reading list on LLM based Synthetic Data Generation 🔥☆1,223Updated last month
- Evaluate your LLM's response with Prometheus and GPT4 💯☆898Updated 2 weeks ago
- awesome synthetic (text) datasets☆265Updated 5 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆822Updated last week
- Minimalistic large language model 3D-parallelism training☆1,737Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,601Updated last week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,329Updated this week
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆669Updated 2 weeks ago
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆460Updated 7 months ago
- Recipes to scale inference-time compute of open models☆1,048Updated last month
- Official repository for ORPO☆446Updated 10 months ago
- List of papers on hallucination detection in LLMs.☆817Updated 3 weeks ago
- A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.☆260Updated 2 weeks ago
- ☆1,011Updated 3 months ago
- Automatic evals for LLMs☆352Updated this week
- RankLLM is a Python toolkit for reproducible information retrieval research using rerankers, with a focus on listwise reranking.☆419Updated this week
- Automated Evaluation of RAG Systems☆569Updated last week
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆692Updated 11 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆350Updated 6 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆253Updated 8 months ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆504Updated 9 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆783Updated last month
- Chat Templates for 🤗 HuggingFace Large Language Models☆640Updated 3 months ago
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆456Updated last year