songmzhang / DSKD

Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same-tokenizer and cross-tokenizer LLM distillation.
☆43Updated 4 months ago

Alternatives and similar repositories for DSKD:

Users that are interested in DSKD are comparing it to the libraries listed below