Alternatives and similar repositories for tutorials:

Users that are interested in tutorials are comparing it to the libraries listed below

• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• IBM / pytorch-communication-benchmarks
  pytorch code examples for measuring the performance of collective communication calls in AI workloads
  ☆12Updated 2 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• BaguaSys / bagua-net
  High performance NCCL plugin for Bagua.
  ☆15Updated 3 years ago
• microsoft / dist-ir
  An IR for efficiently simulating distributed ML computation.
  ☆25Updated last year
• yifuwang / symm-mem-recipes
  ☆28Updated 3 weeks ago
• awslabs / ratex
  ☆23Updated last month
• jiazhihao / sosp19ae
  Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions
  ☆21Updated 2 years ago
• exists-forall / striped_attention
  ☆38Updated last year
• microsoft / DeepSpeed-Kernels
  ☆57Updated 7 months ago
• NVIDIA / compute-sanitizer-samples
  Samples demonstrating how to use the Compute Sanitizer Tools and Public API
  ☆73Updated last year
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆20Updated 8 months ago
• K-Wu / pytorch-direct
  Code for Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture (accepted by PVLDB).The outdated wr…
  ☆8Updated last year
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆39Updated 2 months ago
• chenyu-jiang / nsys2json
  A Python script to convert the output of NVIDIA Nsight Systems (in SQLite format) to JSON in Google Chrome Trace Event Format.
  ☆27Updated 4 months ago
• Jokeren / triton-samples
  ☆23Updated this week
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆55Updated 3 years ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 3 years ago
• NeuHub / TVMDeepDive
  ☆22Updated 5 years ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆12Updated 5 months ago
• VoVAllen / tf-dlpack
  DLPack for Tensorflow
  ☆36Updated 4 years ago
• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆20Updated 5 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆50Updated this week
• iree-org / iree-nvgpu
  ☆48Updated 10 months ago
• mlcommons / logging
  MLPerf™ logging library
  ☆32Updated last week
• zhisbug / Cavs
  Cavs: An Efficient Runtime System for Dynamic Neural Networks
  ☆13Updated 4 years ago
• Funatiq / gossip
  gossip: Efficient Communication Primitives for Multi-GPU Systems
  ☆58Updated 2 years ago
• facebookresearch / DLRM-FlexFlow
  Development repository for integrating FlexFlow (A distributed deep learning framework that supports flexible parallelization strategies)…
  ☆28Updated 3 years ago