facebookresearch / fairscaleLinks
PyTorch extensions for high performance and large scale training.
☆3,337Updated 2 months ago
Alternatives and similar repositories for fairscale
Users that are interested in fairscale are comparing it to the libraries listed below
Sorting:
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆2,700Updated 3 weeks ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,548Updated this week
- Transformer related optimization, including BERT, GPT☆6,238Updated last year
- maximal update parametrization (µP)☆1,554Updated 11 months ago
- Enabling PyTorch on XLA Devices (e.g. Google TPU)☆2,639Updated this week
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,211Updated this week
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆2,105Updated 3 months ago
- Mesh TensorFlow: Model Parallelism Made Easier