GeondoPark / CKD

This repository is the official PyTorch implementation of "Distilling Linguistic Context for Language Model Compression" by GeondoPark, Gyeongman Kim and Eunho Yang.
33Updated 3 years ago

Alternatives and similar repositories for CKD:

Users that are interested in CKD are comparing it to the libraries listed below