BaguaSys / tutorials
Bagua tutorials.
☆12Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for tutorials
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆63Updated 2 years ago
- DL Dataloader Benchmarks☆18Updated 2 months ago
- a high performance system for customized-precision distributed deep learning☆12Updated 3 years ago
- MLPerf™ logging library☆30Updated this week
- ☆26Updated last year
- CUDA 12.2 HMM demos☆17Updated 3 months ago
- Stride visualizations☆36Updated 6 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆60Updated 8 months ago
- This repository contains the results and code for the MLPerf™ Training v1.0 benchmark.☆37Updated 9 months ago
- An IR for efficiently simulating distributed ML computation.☆25Updated 10 months ago
- PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.☆10Updated 2 years ago
- TORCH_LOGS parser for PT2☆22Updated this week
- ☆20Updated last year
- ☆55Updated 6 months ago
- Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…☆28Updated 3 years ago
- A library for syntactically rewriting Python programs, pronounced (sinner).☆70Updated 2 years ago
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Updated 2 years ago
- Test data for DALI project☆40Updated 3 weeks ago
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 3 years ago
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆23Updated this week
- A Python library transfers PyTorch tensors between CPU and NVMe☆98Updated this week
- Test winograd convolution written in TVM for CUDA and AMDGPU☆40Updated 6 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆55Updated 3 years ago
- benchmarking some transformer deployments☆26Updated last year
- Codebase associated with the PyTorch compiler tutorial☆44Updated 5 years ago
- ☆9Updated last month
- ☆14Updated 2 months ago
- CS294-162; Machine Learning Systems Seminar☆31Updated last year
- pytorch-profiler☆50Updated last year