fe1ixxu / Intra-Distillation

This is the repository for our EMNLP 2022 paper "The Importance of Being Parameters: An Intra-Distillation Method for Serious Gains".
10Updated last year

Alternatives and similar repositories for Intra-Distillation:

Users that are interested in Intra-Distillation are comparing it to the libraries listed below