Alternatives and similar repositories for DeepSpeed

Users that are interested in DeepSpeed are comparing it to the libraries listed below

• intel / sycl-tla
  SYCL* Templates for Linear Algebra (SYCL*TLA) - SYCL based CUTLASS implementation for Intel GPUs
  ☆41Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆83Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆75Updated last week
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆102Updated 2 months ago
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆245Updated 3 weeks ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆135Updated this week
• intel / xetla
  ☆63Updated 10 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆63Updated 3 months ago
• libxsmm / tpp-pytorch-extension
  Intel® Tensor Processing Primitives extension for Pytorch*
  ☆17Updated 2 weeks ago
• ROCm / rccl
  ROCm Communication Collectives Library (RCCL)
  ☆389Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆211Updated last week
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆357Updated this week
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆119Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆165Updated 3 weeks ago
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆66Updated this week
• intel / torch-xpu-ops
  ☆59Updated this week
• ROCm / TransformerEngine
  ☆48Updated this week
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆23Updated 6 months ago
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆115Updated this week
• oneapi-src / level-zero-tests
  oneAPI Level Zero Conformance & Performance test content
  ☆57Updated this week
• oneapi-src / level-zero-spec
  ☆19Updated last week
• HabanaAI / hccl_demo
  ☆23Updated last week
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆472Updated this week
• HabanaAI / SynapseAI_Core
  SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi
  ☆43Updated 8 months ago
• ROCm / rocMLIR
  ☆152Updated this week
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆106Updated last year
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆33Updated last month
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆113Updated last week
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated 10 months ago
• intel / pti-gpu
  Profiling Tools Interfaces for GPU (PTI for GPU) is a set of Getting Started Documentation and Tools Library to start performance analysi…
  ☆247Updated last week