Alternatives and similar repositories for DeepSpeed

Users that are interested in DeepSpeed are comparing it to the libraries listed below

• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆102Updated last month
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated 2 months ago
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆76Updated last week
• intel / cutlass-sycl
  SYCL based CUTLASS implementation for Intel GPUs
  ☆39Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆166Updated this week
• intel / torch-xpu-ops
  ☆56Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆131Updated this week
• intel / xetla
  ☆62Updated 9 months ago
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆353Updated last week
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆245Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆208Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆83Updated this week
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆381Updated this week
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆465Updated this week
• NVIDIA / nsight-training
  Training material for Nsight developer tools
  ☆167Updated last year
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆105Updated last year
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆102Updated this week
• ROCm / TransformerEngine
  ☆45Updated this week
• ROCm / rocMLIR
  ☆150Updated this week
• ROCm / MAD
  MAD (Model Automation and Dashboarding)
  ☆25Updated last week
• libxsmm / tpp-pytorch-extension
  Intel® Tensor Processing Primitives extension for Pytorch*
  ☆17Updated this week
• NVIDIA / cudnn-frontend
  cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it
  ☆617Updated last week
• intel / llvm-test-suite
  ☆20Updated 2 years ago
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆117Updated this week
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆111Updated this week
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆111Updated this week
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 9 months ago
• openxla / community
  Stores documents and resources used by the OpenXLA developer community
  ☆129Updated last year
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆66Updated last week
• NVIDIA / compute-sanitizer-samples
  Samples demonstrating how to use the Compute Sanitizer Tools and Public API
  ☆88Updated last year