A validation and profiling tool for AI infrastructure
☆365Mar 17, 2026Updated this week
Alternatives and similar repositories for superbenchmark
Users that are interested in superbenchmark are comparing it to the libraries listed below
Sorting:
- MSCCL++: A GPU-driven communication stack for scalable AI applications☆481Updated this week
- Microsoft Collective Communication Library☆387Sep 20, 2023Updated 2 years ago
- A GPU-driven system framework for scalable AI applications☆124Feb 5, 2025Updated last year
- NCCL Tests☆1,459Mar 11, 2026Updated last week
- Tutel MoE: Optimized Mixture-of-Experts Library, Support GptOss/DeepSeek/Kimi-K2/Qwen3 using FP8/NVFP4/MXFP4☆976Mar 6, 2026Updated 2 weeks ago
- A resilient distributed training framework☆97Apr 11, 2024Updated last year
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆1,003Sep 19, 2024Updated last year
- NCCL Profiling Kit☆152Jul 1, 2024Updated last year
- Depict GPU memory footprint during DNN training of PyTorch☆11Nov 17, 2022Updated 3 years ago
- A tool for bandwidth measurements on NVIDIA GPUs.☆643Apr 15, 2025Updated 11 months ago
- ☆12May 30, 2025Updated 9 months ago
- ☆84Dec 2, 2022Updated 3 years ago
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆1,000Mar 3, 2026Updated 2 weeks ago
- An experimental parallel training platform☆56Mar 25, 2024Updated last year
- Microsoft Collective Communication Library☆66Nov 23, 2024Updated last year
- ☆199Aug 31, 2019Updated 6 years ago
- RDMA and SHARP plugins for nccl library☆224Jan 12, 2026Updated 2 months ago
- ☆176Mar 12, 2024Updated 2 years ago
- A baseline repository of Auto-Parallelism in Training Neural Networks☆147Jun 25, 2022Updated 3 years ago
- Scripts for managing a large H100 cluster and fixing hardware issues to ensure smooth model training.☆323Aug 20, 2024Updated last year
- ☆78May 4, 2021Updated 4 years ago
- CloudAI Benchmark Framework☆89Updated this week
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆932Updated this week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆164Jan 12, 2026Updated 2 months ago
- some sample caffemodel, prototxt, test images and pre compiled loadabes .☆13Apr 30, 2021Updated 4 years ago
- Synthesizer for optimal collective communication algorithms☆123Apr 8, 2024Updated last year
- 🔮 Execution time predictions for deep neural network training iterations across different GPUs.☆64Nov 26, 2022Updated 3 years ago
- OpenPAI SDK☆19Dec 10, 2022Updated 3 years ago
- Training and serving large-scale neural networks with auto parallelization.☆3,187Dec 9, 2023Updated 2 years ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,211Updated this week
- A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology☆1,355Mar 12, 2026Updated last week
- CUDA checkpoint and restore utility☆429Sep 15, 2025Updated 6 months ago
- Benchmarking guide for the Azure AI Infrastructure.☆40Feb 20, 2026Updated last month
- An Attention Superoptimizer☆22Jan 20, 2025Updated last year
- Kubernetes Scheduler for Deep Learning☆264May 22, 2022Updated 3 years ago
- Optimized primitives for collective multi-GPU communication☆4,531Updated this week
- GPU-scheduler-for-deep-learning☆209Nov 5, 2020Updated 5 years ago
- Multi-GPU communication profiler and visualizer☆39Jun 10, 2024Updated last year
- TACCL: Guiding Collective Algorithm Synthesis using Communication Sketches☆80Jul 25, 2023Updated 2 years ago