Alternatives and similar repositories for splitwise-demos:

Users that are interested in splitwise-demos are comparing it to the libraries listed below

• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆282Updated this week
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆151Updated 3 weeks ago
• AlibabaPAI / llumnix
  Efficient and easy multi-instance LLM serving
  ☆383Updated this week
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆346Updated this week
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆61Updated 10 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆118Updated 3 months ago
• ppl-ai / pplx-kernels
  Perplexity GPU Kernels
  ☆235Updated 2 weeks ago
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆348Updated this week
• triton-inference-server / triton_distributed
  ☆48Updated last month
• microsoft / NPKit
  NCCL Profiling Kit
  ☆130Updated 9 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆236Updated last week
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated 11 months ago
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆113Updated 3 weeks ago
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆48Updated 2 months ago
• Azure / msccl-executor-nccl
  ☆36Updated 4 months ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆341Updated this week
• Bruce-Lee-LY / cuda_hook
  Hooked CUDA-related dynamic libraries by using automated code generation tools.
  ☆152Updated last year
• OpenPPL / ppl.llm.kernel.cuda
  ☆148Updated 3 months ago
• xlite-dev / hgemm-tensorcores-mma
  ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
  ☆73Updated 3 weeks ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆34Updated last week
• shenh10 / DeepSeek_Simulator
  ☆58Updated 3 weeks ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆65Updated 5 months ago
• InternLM / turbomind
  ☆82Updated 3 weeks ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆88Updated this week
• DicardoX / Research-Space
  This repository is established to store personal notes and annotated papers during daily research.
  ☆117Updated this week
• yifuwang / symm-mem-recipes
  ☆66Updated 3 months ago
• LoongServe / LoongServe
  ☆95Updated 5 months ago
• FlagOpen / FlagCX
  ☆49Updated this week
• sunkx109 / GPUs-Specs
  Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM
  ☆40Updated last month
• LLMServe / DistServe
  Disaggregated serving system for Large Language Models (LLMs).
  ☆562Updated 2 weeks ago