Alternatives and similar repositories for DeepSpeed

Users that are interested in DeepSpeed are comparing it to the libraries listed below

• intel / torch-ccl
  oneCCL Bindings for Pytorch* (deprecated)
  ☆104Updated last month
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆64Updated 7 months ago
• intel / sycl-tla
  SYCL* Templates for Linear Algebra (SYCL*TLA) - SYCL based CUTLASS implementation for Intel GPUs
  ☆66Updated last week
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆254Updated last week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆85Updated this week
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆170Updated 3 weeks ago
• ROCm / rccl-tests
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆86Updated 2 weeks ago
• libxsmm / tpp-pytorch-extension
  Intel® Tensor Processing Primitives extension for Pytorch*
  ☆18Updated 3 weeks ago
• intel / xetla
  ☆61Updated last year
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆140Updated last week
• mlcommons / inference_policies
  Issues related to MLPerf® Inference policies, including rules and suggested changes
  ☆63Updated this week
• ROCm / rccl
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆410Updated this week
• NVIDIA / nsight-training
  Training material for Nsight developer tools
  ☆177Updated last year
• ROCm / composable_kernel
  [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror
  ☆518Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆226Updated this week
• ROCm / TransformerEngine
  ☆60Updated this week
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆25Updated 9 months ago
• ROCm / rocSHMEM
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆144Updated this week
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆34Updated 10 months ago
• HabanaAI / hccl_demo
  ☆24Updated 3 months ago
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆380Updated this week
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆156Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆276Updated 6 months ago
• bytedance / xpu-perf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆298Updated 2 weeks ago
• oneapi-src / level-zero-tests
  oneAPI Level Zero Conformance & Performance test content
  ☆60Updated this week
• intel / torch-xpu-ops
  ☆74Updated this week
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆36Updated 5 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated last year
• NVIDIA / nvbandwidth
  A tool for bandwidth measurements on NVIDIA GPUs.
  ☆617Updated 9 months ago
• NVIDIA / MagnumIO
  Magnum IO community repo
  ☆109Updated 2 months ago