fattorib / ZeRO-transformerLinks

Two implementations of ZeRO-1 optimizer sharding in JAX
14Updated last year

Alternatives and similar repositories for ZeRO-transformer

Users that are interested in ZeRO-transformer are comparing it to the libraries listed below

Sorting: