BaguaSys / tutorials
Bagua tutorials.
☆12Updated 2 years ago
Alternatives and similar repositories for tutorials:
Users that are interested in tutorials are comparing it to the libraries listed below
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆64Updated 3 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆62Updated last year
- A GPU performance profiling tool for PyTorch models☆22Updated 2 years ago
- Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…☆28Updated 3 years ago
- A Python library transfers PyTorch tensors between CPU and NVMe☆111Updated 4 months ago
- An IR for efficiently simulating distributed ML computation.☆28Updated last year
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 3 years ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆104Updated this week
- ☆63Updated this week
- Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions☆21Updated 2 years ago
- DLPack for Tensorflow☆36Updated 4 years ago
- An external memory allocator example for PyTorch.☆14Updated 3 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆155Updated 3 months ago
- Home for OctoML PyTorch Profiler☆108Updated last year
- ☆11Updated 3 years ago
- This repository contains the results and code for the MLPerf™ Training v1.0 benchmark.☆38Updated last year
- TORCH_LOGS parser for PT2☆36Updated this week
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆74Updated this week
- A library for syntactically rewriting Python programs, pronounced (sinner).☆70Updated 3 years ago
- PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021☆56Updated 3 years ago
- pytorch code examples for measuring the performance of collective communication calls in AI workloads☆16Updated 5 months ago
- Prototype routines for GPU quantization written using PyTorch.☆20Updated last month
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated 2 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆178Updated 3 months ago
- Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).☆22Updated 9 months ago
- System for automated integration of deep learning backends.☆48Updated 2 years ago
- Odysseus: Playground of LLM Sequence Parallelism☆68Updated 9 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆77Updated 4 months ago
- Code for Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture (accepted by PVLDB).The outdated wr…☆9Updated last year