kyegomez / Mixture-of-Depths

Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
86Updated 3 weeks ago

Alternatives and similar repositories for Mixture-of-Depths:

Users that are interested in Mixture-of-Depths are comparing it to the libraries listed below