Tebmer / Awesome-Knowledge-Distillation-of-LLMsLinks
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
β1,134Updated 5 months ago
Alternatives and similar repositories for Awesome-Knowledge-Distillation-of-LLMs
Users that are interested in Awesome-Knowledge-Distillation-of-LLMs are comparing it to the libraries listed below
Sorting:
- π° Must-read papers and blogs on LLM based Long Context Modeling π₯β1,670Updated this week
- A curated list for Efficient Large Language Modelsβ1,835Updated 2 months ago
- [TMLR 2024] Efficient Large Language Models: A Surveyβ1,200Updated 2 months ago
- Latest Advances on System-2 Reasoningβ1,224Updated 2 months ago
- Awesome LLM compression research papers and tools.β1,639Updated last month
- Must-read Papers on Knowledge Editing for Large Language Models.β1,130Updated last month
- [NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichβ¦