Pipeline Parallelism Emulation and Visualization
☆79Jan 8, 2026Updated last month
Alternatives and similar repositories for PP-Schedule-Visualization
Users that are interested in PP-Schedule-Visualization are comparing it to the libraries listed below
Sorting:
- Ongoing research training transformer models at scale☆18Updated this week
- A collection of specialized agent skills for AI infrastructure development, enabling Claude Code to write, optimize, and debug high-perfo…☆61Feb 2, 2026Updated 3 weeks ago
- ☆42Sep 8, 2025Updated 5 months ago
- DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.☆93Jan 16, 2026Updated last month
- ☆49Feb 5, 2026Updated 3 weeks ago
- a simple API to use CUPTI☆11Aug 19, 2025Updated 6 months ago
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆30Apr 22, 2025Updated 10 months ago
- Estimate MFU for DeepSeekV3☆26Jan 5, 2025Updated last year
- Cute layout visualization☆30Jan 18, 2026Updated last month
- (WIP) Parallel inference for black-forest-labs' FLUX model.☆18Nov 18, 2024Updated last year
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆163Feb 11, 2026Updated 2 weeks ago
- A lightweight design for computation-communication overlap.☆221Jan 20, 2026Updated last month
- Allow torch tensor memory to be released and resumed later☆220Feb 9, 2026Updated 2 weeks ago
- DeeperGEMM: crazy optimized version☆74May 5, 2025Updated 9 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆264Updated this week
- ☆159Dec 27, 2024Updated last year
- A CUDA kernel for NHWC GroupNorm for PyTorch☆23Nov 15, 2024Updated last year
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆938Nov 27, 2025Updated 3 months ago
- Distributed Compiler based on Triton for Parallel Systems☆1,361Feb 13, 2026Updated 2 weeks ago
- Toolchain built around the Megatron-LM for Distributed Training☆88Dec 7, 2025Updated 2 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆193Jan 28, 2025Updated last year
- FlashInfer Bench @ MLSys 2026: Building AI agents to write high performance GPU kernels☆137Feb 9, 2026Updated 2 weeks ago
- ☆52May 19, 2025Updated 9 months ago
- ☆20Jun 26, 2024Updated last year
- ☆347Jan 28, 2026Updated last month
- A bidirectional pipeline parallelism algorithm for computation-communication overlap in DeepSeek V3/R1 training.☆2,926Jan 14, 2026Updated last month
- ☆88May 31, 2025Updated 9 months ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,261Aug 28, 2025Updated 6 months ago
- The tool facilitates debugging convergence issues and testing new algorithms and recipes for training LLMs using Nvidia libraries such as…☆18Sep 17, 2025Updated 5 months ago
- ☆28Jan 17, 2025Updated last year
- Tutorials for NVIDIA CUPTI samples☆55Nov 3, 2025Updated 3 months ago
- ☆34Sep 10, 2024Updated last year
- Microsoft Automatic Mixed Precision Library☆636Dec 1, 2025Updated 2 months ago
- LLM training technologies developed by kwai☆70Jan 21, 2026Updated last month
- Training library for Megatron-based models with bidirectional Hugging Face conversion capability☆459Updated this week
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,528Dec 15, 2025Updated 2 months ago
- Official implementation for Training LLMs with MXFP4☆119Apr 25, 2025Updated 10 months ago
- nnScaler: Compiling DNN models for Parallel Training☆124Sep 23, 2025Updated 5 months ago
- NVIDIA cuTile learn☆163Dec 9, 2025Updated 2 months ago