Alternatives and similar repositories for MAD:

Users that are interested in MAD are comparing it to the libraries listed below

• ROCm / Megatron-LM
  Ongoing research training transformer models at scale
  ☆18Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆64Updated this week
• ROCm / TransformerEngine
  ☆29Updated this week
• ROCm / pytorch-micro-benchmarking
  ☆20Updated 3 weeks ago
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆91Updated this week
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆54Updated 2 weeks ago
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆136Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆180Updated this week
• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆62Updated 2 weeks ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆65Updated 5 months ago
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆33Updated 4 months ago
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆76Updated last week
• ROCm / rocmProfileData
  ☆22Updated 2 months ago
• ColfaxResearch / cfx-article-src
  ☆102Updated last month
• intel / torch-xpu-ops
  ☆38Updated this week
• yifuwang / symm-mem-recipes
  ☆68Updated 3 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated last month
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆342Updated this week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆75Updated this week
• parasailteam / coconet
  ☆78Updated 2 years ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆132Updated 9 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆94Updated 2 weeks ago
• ROCm / TransferBench
  TransferBench is a utility capable of benchmarking simultaneous copies between user-specified devices (CPUs/GPUs)
  ☆39Updated 2 weeks ago
• ROCm / roctracer
  ROCm Tracer Callback/Activity Library for Performance tracing AMD GPUs
  ☆83Updated this week
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆57Updated last week
• ROCm / rdc
  RDC
  ☆28Updated this week
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆105Updated last year
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 5 months ago
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆31Updated 2 months ago
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆54Updated last year