Alternatives and similar repositories for StragglerAnalysis

Users that are interested in StragglerAnalysis are comparing it to the libraries listed below

• WukLab / preble
  Stateful LLM Serving
  ☆79Updated 4 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆155Updated last month
• hao-ai-lab / MuxServe
  ☆67Updated last year
• ovg-project / kvcached
  kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.
  ☆35Updated last week
• abcdabcd987 / libfabric-efa-demo
  ☆48Updated 7 months ago
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆19Updated last year
• alibaba / ServeGen
  A framework for generating realistic LLM serving workloads
  ☆51Updated last month
• stepfun-ai / StepMesh
  ☆209Updated this week
• Azure / msccl
  Microsoft Collective Communication Library
  ☆63Updated 8 months ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆48Updated last week
• google / iopddl
  Supplemental materials for The ASPLOS 2025 / EuroSys 2025 Contest on Intra-Operator Parallelism for Distributed Deep Learning
  ☆23Updated 2 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆71Updated 3 months ago
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆51Updated 2 months ago
• gty111 / gLLM
  gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
  ☆37Updated this week
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆170Updated 10 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• Azure / msccl-executor-nccl
  ☆37Updated 7 months ago
• Infrawaves / DeepEP_ibrc_dual-ports_multiQP
  Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport
  ☆57Updated 2 months ago
• ParCIS / Chimera
  Chimera: bidirectional pipeline parallelism for efficiently training large-scale models.
  ☆66Updated 4 months ago
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆26Updated last month
• UChi-JCL / CacheGen
  ☆115Updated 9 months ago
• tile-ai / tilescale
  Tile-based language built for AI computation across all scales
  ☆31Updated this week
• flashinfer-ai / cutlass-viz
  ☆60Updated 3 months ago
• casys-kaist / EnvPipe
  ☆25Updated last year
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆62Updated last year
• NEO-MLSys25 / NEO
  NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading
  ☆49Updated last month
• Hsword / SpotServe
  SpotServe: Serving Generative Large Language Models on Preemptible Instances
  ☆125Updated last year
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆38Updated this week
• LoongServe / LoongServe
  ☆109Updated 8 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆42Updated 5 months ago