astramind-ai / Mixture-of-depthsLinks

Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
160Updated 11 months ago

Alternatives and similar repositories for Mixture-of-depths

Users that are interested in Mixture-of-depths are comparing it to the libraries listed below

Sorting: