heartcored98 / transformer_anatomy

Official Pytorch implementation of (Roles and Utilization of Attention Heads in Transformer-based Neural Language Models), ACL 2020
16Updated 2 years ago

Alternatives and similar repositories for transformer_anatomy:

Users that are interested in transformer_anatomy are comparing it to the libraries listed below