liangyuRain / ForestColl

Related projects ⓘ

Alternatives and complementary repositories for ForestColl

• LLMServe / dLoRA-artifact
  ☆14Updated 5 months ago
• suquark / hoplite
  ☆43Updated 3 years ago
• zhuangwang93 / Cupcake
  Cupcake: A Compression Scheduler for Scalable Communication-Efficient Distributed Training (MLSys '23)
  ☆9Updated last year
• uclasystem / bamboo
  Bamboo is a system for running large pipeline-parallel DNNs affordably, reliably, and efficiently using spot instances.
  ☆47Updated last year
• jasperzhong / swift
  ☆13Updated 2 years ago
• llm-db / FineInfer
  Deferred Continuous Batching in Resource-Efficient Large Language Model Serving (EuroMLSys 2024)
  ☆11Updated 5 months ago
• microsoft / TE-CCL
  ☆22Updated 2 months ago
• Nu-NSDI23 / Nu
  Nu is a new datacenter system that enables developers to build fungible applications that can use datacenter resources wherever they are.
  ☆35Updated 6 months ago
• utnslab / Medes
  Deduplication over dis-aggregated memory for Serverless Computing
  ☆12Updated 2 years ago
• smartnickit-project / smartnic-bench
  A rust-based benchmark for BlueField SmartNICs.
  ☆27Updated last year
• alibaba / alibaba-lingjun-dataset-2023
  ☆34Updated 5 months ago
• uclasystem / dorylus
  Dorylus: Affordable, Scalable, and Accurate GNN Training
  ☆77Updated 3 years ago
• SJTU-IPADS / reef
  REEF is a GPU-accelerated DNN inference serving system that enables instant kernel preemption and biased concurrent execution in GPU sche…
  ☆85Updated last year
• casys-kaist / EnvPipe
  ☆24Updated last year
• netx-repo / NetLock
  NetLock: Fast, Centralized Lock Management Using Programmable Switches
  ☆30Updated 4 years ago
• dywsjtu / apparate
  Code for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆16Updated this week
• spcl / rFaaS
  rFaaS: a high-performance FaaS platform with RDMA acceleration for low-latency invocations.
  ☆49Updated last month
• pkusys / Auncel
  Vector search with bounded performance.
  ☆33Updated 10 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆38Updated 3 months ago
• SJTU-IPADS / ugache
  ☆23Updated last year
• csl-iisc / GPM-ASPLOS22
  ☆31Updated 5 months ago
• msr-fiddle / synergy
  ☆48Updated last year
• host-bench / husky
  Benchmark Suite for RDMA Performance Isolation
  ☆36Updated last year
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated 9 months ago
• harvard-cns / Harvard-CNS-Seminar
  Reading seminar in Harvard Cloud Networking and Systems Group
  ☆16Updated 2 years ago
• zhuangwang93 / Espresso
  Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…
  ☆15Updated last year
• James-QiuHaoran / LLM-serving-with-proxy-models
  Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny model can tell you the verbosity of an LLM (…
  ☆22Updated 5 months ago
• Froot-NetSys / Arya
  Arya: Arbitrary Graph Pattern Mining with Decomposition-based Sampling
  ☆13Updated last year
• casys-kaist / glet
  ☆41Updated last year