Alternatives and similar repositories for MAD

Users that are interested in MAD are comparing it to the libraries listed below

• ROCm / TransformerEngine
  ☆48Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆75Updated last week
• ROCm / Megatron-LM
  Ongoing research training transformer models at scale
  ☆29Updated this week
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆153Updated this week
• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆285Updated last week
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated 10 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆102Updated 2 months ago
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆550Updated 6 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆135Updated this week
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆119Updated this week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆63Updated 3 months ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆145Updated last year
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆421Updated last week
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆265Updated 2 months ago
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆389Updated this week
• Azure / msccl-executor-nccl
  ☆46Updated 10 months ago
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆66Updated this week
• cwpearson / nvidia-performance-tools
  Instructions, Docker images, and examples for Nsight Compute and Nsight Systems
  ☆133Updated 5 years ago
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆245Updated 3 weeks ago
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆357Updated this week
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆226Updated this week
• microsoft / superbenchmark
  A validation and profiling tool for AI infrastructure
  ☆341Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆211Updated this week
• intel / sycl-tla
  SYCL* Templates for Linear Algebra (SYCL*TLA) - SYCL based CUTLASS implementation for Intel GPUs
  ☆41Updated this week
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆121Updated last year
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆115Updated this week
• merthidayetoglu / HiCCL
  A hierarchical collective communications library with portable optimizations
  ☆36Updated 10 months ago
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆108Updated this week
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆185Updated last week
• ROCm / iris
  AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming
  ☆91Updated this week