Scripts for managing a large H100 cluster and fixing hardware issues to ensure smooth model training.
☆323Aug 20, 2024Updated last year
Alternatives and similar repositories for cluster-health
Users that are interested in cluster-health are comparing it to the libraries listed below
Sorting:
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆479Updated this week
- Cost aware hyperparameter tuning algorithm☆184Jun 27, 2024Updated last year
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆1,000Mar 3, 2026Updated 2 weeks ago
- Health checks for Azure N- and H-series VMs.☆57Feb 5, 2026Updated last month
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆487Updated this week
- Optimized primitives for collective multi-GPU communication☆10May 8, 2024Updated last year
- ☆32Oct 31, 2025Updated 4 months ago
- NCCL Profiling Kit☆152Jul 1, 2024Updated last year
- DLRover: An Automatic Distributed Deep Learning System☆1,640Updated this week
- NCCL Tests☆1,459Mar 11, 2026Updated last week
- CUDA checkpoint and restore utility☆429Sep 15, 2025Updated 6 months ago
- A tool to detect infrastructure issues on cloud native AI systems☆52Sep 18, 2025Updated 6 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆267Mar 13, 2026Updated last week
- A validation and profiling tool for AI infrastructure☆365Updated this week
- A library to analyze PyTorch traces.☆474Updated this week
- Cray-LM unified training and inference stack.☆22Jan 30, 2025Updated last year
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆932Updated this week
- ☆176Mar 12, 2024Updated 2 years ago
- Minimalistic large language model 3D-parallelism training☆2,609Feb 19, 2026Updated last month
- A resilient distributed training framework☆97Apr 11, 2024Updated last year
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆170Feb 11, 2026Updated last month
- ☆10Jun 28, 2025Updated 8 months ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆4,921Updated this week
- NVIDIA NCCL Tests for Distributed Training☆138Mar 12, 2026Updated last week
- A tool for bandwidth measurements on NVIDIA GPUs.☆643Apr 15, 2025Updated 11 months ago
- RDMA and SHARP plugins for nccl library☆224Jan 12, 2026Updated 2 months ago
- ☆338Mar 11, 2026Updated last week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆282Nov 24, 2025Updated 3 months ago
- Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the…☆366Mar 12, 2026Updated last week
- Perplexity GPU Kernels☆566Nov 7, 2025Updated 4 months ago
- A PyTorch native platform for training generative AI models☆5,139Mar 13, 2026Updated last week
- PyTorch bindings for CUTLASS grouped GEMM.☆186Feb 19, 2026Updated last month
- Efficient Triton Kernels for LLM Training☆6,216Updated this week
- Optimized primitives for collective multi-GPU communication☆4,531Updated this week
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆33Sep 28, 2025Updated 5 months ago
- Infiniband Verbs Performance Tests☆927Updated this week
- NVIDIA Data Center GPU Manager (DCGM) is a project for gathering telemetry and measuring the health of NVIDIA GPUs☆685Feb 17, 2026Updated last month
- a high performance system for customized-precision distributed deep learning☆12Dec 10, 2020Updated 5 years ago
- A TUI-based utility for real-time monitoring of InfiniBand traffic and performance metrics on the local node☆64Dec 19, 2025Updated 3 months ago