Tebmer / Awesome-Knowledge-Distillation-of-LLMs

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
β˜†757Updated 3 months ago

Alternatives and similar repositories for Awesome-Knowledge-Distillation-of-LLMs:

Users that are interested in Awesome-Knowledge-Distillation-of-LLMs are comparing it to the libraries listed below