Scripts for managing a large H100 cluster and fixing hardware issues to ensure smooth model training.
☆327Aug 20, 2024Updated 2 years ago
Alternatives and similar repositories for cluster-health
Users that are interested in cluster-health are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GPUd automates monitoring, diagnostics, and issue identification for GPUs☆498Updated this week
- Optimized primitives for collective multi-GPU communication☆11May 8, 2024Updated 2 years ago
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆1,046Mar 3, 2026Updated 7 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆345Updated this week
- Cost aware hyperparameter tuning algorithm☆197Jun 27, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆552Updated this week
- Health checks for Azure N- and H-series VMs.☆60Oct 2, 2026Updated 3 weeks ago
- ☆39Oct 12, 2026Updated 2 weeks ago
- DLRover: An Automatic Distributed Deep Learning System☆1,690Oct 22, 2026Updated last week
- NCCL Profiling Kit☆156Jul 1, 2024Updated 2 years ago
- A tool to detect infrastructure issues on cloud native AI systems☆56Sep 18, 2025Updated last year
- NCCL Tests☆1,682Oct 5, 2026Updated 3 weeks ago
- ☆27Jun 29, 2026Updated 4 months ago
- CUDA checkpoint and restore utility☆504Jul 6, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A tool for bandwidth measurements on NVIDIA GPUs.☆793Jul 28, 2026Updated 3 months ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆997Sep 28, 2026Updated last month
- NVIDIA NCCL Tests for Distributed Training☆162Updated this week
- A library to analyze PyTorch traces.☆564Updated this week
- A validation and profiling tool for AI infrastructure☆400Updated this week
- Infiniband Verbs Performance Tests☆1,038Oct 21, 2026Updated last week
- Dynolog is a telemetry daemon for performance monitoring and tracing. It exports metrics from different components in the system like the…☆386Oct 22, 2026Updated last week
- A PyTorch native platform for training generative AI models☆5,858Updated this week
- ☆15Dec 24, 2025Updated 10 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Where GPUs get cooked 👩🍳🔥☆413Sep 24, 2026Updated last month
- Cray-LM unified training and inference stack.☆22Jan 30, 2025Updated last year
- Perplexity GPU Kernels☆614Nov 7, 2025Updated 11 months ago
- PyTorch bindings for CUTLASS grouped GEMM.☆193Apr 8, 2026Updated 6 months ago
- Efficient Triton Kernels for LLM Training☆6,678Updated this week
- ☆387Updated this week
- ☆95Jul 5, 2024Updated 2 years ago
- Tile primitives for speedy kernels☆3,786Sep 12, 2026Updated last month
- Microsoft Collective Communication Library☆400Aug 25, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 4 years ago
- Tools for building GPU clusters☆1,483Updated this week
- ☆16Aug 26, 2026Updated 2 months ago
- ☆186Mar 12, 2024Updated 2 years ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆289Nov 24, 2025Updated 11 months ago
- Minimalistic large language model 3D-parallelism training☆2,850Oct 8, 2026Updated 3 weeks ago
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆1,018Oct 22, 2026Updated last week