Alternatives and similar repositories for DeepSpeed

Users that are interested in DeepSpeed are comparing it to the libraries listed below

• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆70Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆125Updated this week
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆99Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆77Updated this week
• codeplaysoftware / cutlass-sycl
  A CUTLASS implementation using SYCL
  ☆30Updated last week
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆238Updated last week
• ROCm / TransformerEngine
  ☆40Updated this week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated 2 weeks ago
• intel / torch-xpu-ops
  ☆48Updated this week
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆343Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆193Updated this week
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆99Updated last year
• intel / xetla
  ☆62Updated 7 months ago
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆349Updated this week
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆437Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆166Updated last week
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆22Updated 3 months ago
• libxsmm / tpp-pytorch-extension
  Intel® Tensor Processing Primitives extension for Pytorch*
  ☆17Updated this week
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆147Updated 2 weeks ago
• NVIDIA / nsight-training
  Training material for Nsight developer tools
  ☆161Updated 11 months ago
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆91Updated this week
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆107Updated this week
• ROCm / rocMLIR
  ☆148Updated this week
• ColfaxResearch / cutlass-kernels
  ☆216Updated last year
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆30Updated 4 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆251Updated 2 weeks ago
• libxsmm / parlooper
  PArallelLOOPgEneratoR: Threaded Loops Code Generation Infrastructure targeting Tensor Contraction Applications such as GEMMs, Convolution…
  ☆19Updated last month
• ROCm / rocmProfileData
  ☆25Updated 3 weeks ago
• wzsh / wmma_tensorcore_sample
  Matrix Multiply-Accumulate with CUDA and WMMA( Tensor Core)
  ☆138Updated 4 years ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆255Updated 8 months ago