foundation-model-stack / fms-fsdpLinks

๐Ÿš€ Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.
โ˜†258Updated last week

Alternatives and similar repositories for fms-fsdp

Users that are interested in fms-fsdp are comparing it to the libraries listed below

Sorting: