Alternatives and similar repositories for libfabric-efa-demo

Users that are interested in libfabric-efa-demo are comparing it to the libraries listed below

• Azure / msccl-executor-nccl
  ☆37Updated 7 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆76Updated 4 months ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆146Updated 3 weeks ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆95Updated 2 months ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆139Updated last year
• HPMLL / NVIDIA-Hopper-Benchmark
  ☆49Updated last month
• hao-ai-lab / MuxServe
  ☆64Updated last year
• Azure / msccl
  Microsoft Collective Communication Library
  ☆64Updated 7 months ago
• Infrawaves / DeepEP_ibrc_dual-ports_multiQP
  Aims to implement dual-port and multi-qp solutions in deepEP ibrc transport
  ☆55Updated 2 months ago
• ByteDance-Seed / StragglerAnalysis
  ☆37Updated 2 months ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆59Updated last year
• NEO-MLSys25 / NEO
  NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading
  ☆44Updated last month
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆69Updated 2 months ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆48Updated 2 months ago
• uccl-project / uccl
  Ultra and Unified CCL
  ☆390Updated this week
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆125Updated 5 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• eth-easl / orion
  An interference-aware scheduler for fine-grained GPU sharing
  ☆142Updated 5 months ago
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆155Updated 3 months ago
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆80Updated last week
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆38Updated last week
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆113Updated last week
• shenh10 / DeepSeek_Simulator
  ☆80Updated 3 months ago
• quiver-team / quiver-feature
  High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph
  ☆54Updated 3 years ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆79Updated 7 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆168Updated 9 months ago
• bytedance / InfiniStore
  KV cache store for distributed LLM inference
  ☆290Updated last month
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆36Updated 3 years ago
• SJTU-IPADS / PhoenixOS
  Fast OS-level support for GPU checkpoint and restore
  ☆212Updated 3 weeks ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆61Updated last year