arcee-ai / DistillKitLinks
An Open Source Toolkit For LLM Distillation
☆833Updated last month
Alternatives and similar repositories for DistillKit
Users that are interested in DistillKit are comparing it to the libraries listed below
Sorting:
- [ICLR 2025] Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing. Your efficient and high-quality synthetic data …☆820Updated 10 months ago
- ☆559Updated last year
- Official repository for ORPO☆469Updated last year
- A library for easily merging multiple LLM experts, and efficiently train the merged LLM.☆500Updated last year
- Recipes to scale inference-time compute of open models☆1,124Updated 8 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,274Updated last week
- OLMoE: Open Mixture-of-Experts Language Models☆950Updated 4 months ago
- Automatic evals for LLMs☆575Updated last month
- Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.☆750Updated last year
- ☆1,032Updated last year
- A project to improve skills of large language models☆786Updated this week
- Chat Templates for 🤗 HuggingFace Large Language Models☆713Updated last year
- Large Reasoning Models☆807Updated last year
- FuseAI Project☆586Updated last year
- A family of compressed models obtained via pruning and knowledge distillation☆363Updated 2 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆245Updated last year
- Code for Quiet-STaR☆742Updated last year
- Automatically evaluate your LLMs in Google Colab☆683Updated last year
- A compact LLM pretrained in 9 days by using high quality data☆340Updated 9 months ago
- ☆971Updated last year
- Synthetic data curation for post-training and structured data extraction☆1,609Updated this week
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆366Updated last year
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆370Updated last year
- 🤗 Benchmark Large Language Models Reliably On Your Data☆424Updated 3 weeks ago
- Best practices for distilling large language models.☆600Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆260Updated last year
- LLM model quantization (compression) toolkit with hw acceleration support for Nvidia CUDA, AMD ROCm, Intel XPU and Intel/AMD/Apple CPU vi…☆982Updated last week
- Arena-Hard-Auto: An automatic LLM benchmark.☆988Updated 7 months ago
- [COLM 2025] LIMO: Less is More for Reasoning☆1,062Updated 5 months ago
- Minimalistic large language model 3D-parallelism training☆2,497Updated last month