awslabs / slapo
A schedule language for large model training
☆145Updated 10 months ago
Alternatives and similar repositories for slapo:
Users that are interested in slapo are comparing it to the libraries listed below
- ☆72Updated 3 years ago
- ☆141Updated 2 months ago
- ☆43Updated last year
- ☆23Updated 4 months ago
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆135Updated 2 years ago
- ☆78Updated 2 years ago
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆38Updated 2 years ago
- extensible collectives library in triton☆85Updated 2 weeks ago
- FTPipe and related pipeline model parallelism research.☆41Updated last year
- ☆139Updated 8 months ago
- Home for OctoML PyTorch Profiler☆112Updated last year
- System for automated integration of deep learning backends.☆47Updated 2 years ago
- ☆103Updated 7 months ago
- ☆66Updated 3 months ago
- ☆77Updated 5 months ago
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated last year
- ☆91Updated 2 years ago
- Research and development for optimizing transformers☆125Updated 4 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆156Updated 4 months ago
- Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.☆62Updated 3 weeks ago
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆119Updated 2 years ago
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆81Updated last year
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆79Updated 4 months ago
- Training neural networks in TensorFlow 2.0 with 5x less memory☆130Updated 3 years ago
- An experimental parallel training platform☆54Updated last year
- Boost hardware utilization for ML training workloads via Inter-model Horizontal Fusion☆32Updated 11 months ago
- 🔮 Execution time predictions for deep neural network training iterations across different GPUs.☆60Updated 2 years ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆50Updated 8 months ago
- DietCode Code Release☆63Updated 2 years ago
- nnScaler: Compiling DNN models for Parallel Training☆106Updated 2 months ago