predibase / llm_distillation_playbook
Best practices for distilling large language models.
☆431Updated 11 months ago
Alternatives and similar repositories for llm_distillation_playbook:
Users that are interested in llm_distillation_playbook are comparing it to the libraries listed below
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,022Updated this week
- An Open Source Toolkit For LLM Distillation☆442Updated 3 weeks ago
- ☆489Updated 2 months ago
- Official repository for ORPO☆432Updated 7 months ago
- Automatically evaluate your LLMs in Google Colab☆583Updated 8 months ago
- Easily embed, cluster and semantically label text datasets☆494Updated 10 months ago
- Minimalistic large language model 3D-parallelism training☆1,400Updated this week
- LLM Workshop by Sourab Mangrulkar☆363Updated 7 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆791Updated this week
- Generative Representational Instruction Tuning☆588Updated last week
- Implementation of paper Data Engineering for Scaling Language Models to 128K Context☆450Updated 10 months ago
- ☆797Updated this week
- Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verifi…☆2,064Updated this week
- Toolkit for attaching, training, saving and loading of new heads for transformer models☆260Updated this week
- Official repository for ICLR 2025 paper "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient an…☆587Updated last week
- Generate textbook-quality synthetic LLM pretraining data☆493Updated last year
- NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day☆255Updated last year
- RewardBench: the first evaluation tool for reward models.☆493Updated this week
- awesome synthetic (text) datasets☆256Updated 3 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆971Updated 3 weeks ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆687Updated 9 months ago
- ReFT: Representation Finetuning for Language Models☆1,388Updated 3 weeks ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆491Updated 7 months ago
- Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM☆894Updated this week
- Automated Evaluation of RAG Systems☆532Updated 2 months ago
- Domain Adapted Language Modeling Toolkit - E2E RAG☆313Updated 2 months ago
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,167Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆854Updated 3 weeks ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆263Updated 7 months ago
- A reading list on LLM based Synthetic Data Generation 🔥☆993Updated 2 months ago