awslabs / slapo
A schedule language for large model training
☆141Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for slapo
- ☆140Updated last year
- ☆44Updated last year
- SparseTIR: Sparse Tensor Compiler for Deep Learning☆131Updated last year
- ☆65Updated 3 years ago
- PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections☆114Updated 2 years ago
- ☆131Updated 3 months ago
- Automated Parallelization System and Infrastructure for Multiple Ecosystems☆75Updated this week
- Research and development for optimizing transformers☆125Updated 3 years ago
- ☆23Updated 10 months ago
- ☆88Updated 2 months ago
- extensible collectives library in triton☆71Updated last month
- ☆73Updated last year
- (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.☆34Updated 2 years ago
- FTPipe and related pipeline model parallelism research.☆41Updated last year
- System for automated integration of deep learning backends.☆48Updated 2 years ago
- ☆45Updated 2 weeks ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆98Updated last week
- Home for OctoML PyTorch Profiler☆107Updated last year
- A fast communication-overlapping library for tensor parallelism on GPUs.☆224Updated 3 weeks ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆49Updated 3 months ago
- Applied AI experiments and examples for PyTorch☆166Updated 3 weeks ago
- ☆90Updated 2 years ago
- ☆167Updated 4 months ago
- DietCode Code Release☆62Updated 2 years ago
- Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity☆180Updated last year
- Training neural networks in TensorFlow 2.0 with 5x less memory☆129Updated 2 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆60Updated 8 months ago
- ☆148Updated 5 months ago
- ☆46Updated 5 months ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆146Updated 2 weeks ago