Alternatives and similar repositories for Moneo:

Users that are interested in Moneo are comparing it to the libraries listed below

• mlcommons / inference_policies
  Issues related to MLPerf™ Inference policies, including rules and suggested changes
  ☆59Updated last week
• Azure / msccl
  Microsoft Collective Communication Library
  ☆61Updated 2 months ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆127Updated 7 months ago
• SJTU-IPADS / disb
  DISB is a new DNN inference serving benchmark with diverse workloads and models, as well as real-world traces.
  ☆53Updated 5 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆46Updated 6 months ago
• S-Lab-System-Group / Awesome-ML-for-System
  SOTA Learning-augmented Systems
  ☆34Updated 2 years ago
• microsoft / dist-ir
  An IR for efficiently simulating distributed ML computation.
  ☆27Updated last year
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated 11 months ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆58Updated 9 months ago
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆19Updated this week
• Azure / msccl-executor-nccl
  ☆36Updated 2 months ago
• dywsjtu / apparate
  Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]
  ☆22Updated 2 months ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆60Updated 8 months ago
• microsoft / ark
  A GPU-driven system framework for scalable AI applications
  ☆111Updated last week
• SJTU-IPADS / reef-artifacts
  A GPU-accelerated DNN inference serving system that supports instant kernel preemption and biased concurrent execution in GPU scheduling.
  ☆40Updated 2 years ago
• mcrl / tccl
  Thunder Research Group's Collective Communication Library
  ☆32Updated 9 months ago
• Mellanox / nccl-rdma-sharp-plugins
  RDMA and SHARP plugins for nccl library
  ☆175Updated 3 weeks ago
• msr-fiddle / CoorDL
  ☆23Updated last year
• HuaizhengZhang / MIGProfiler
  Multi-Instance-GPU profiling tool
  ☆56Updated last year
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆103Updated 10 months ago
• geoffxy / habitat
  🔮 Execution time predictions for deep neural network training iterations across different GPUs.
  ☆59Updated 2 years ago
• bd-iaas-us / infiniStore
  A distributed KV store for disaggregated LLM inference
  ☆28Updated this week
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆115Updated last year
• openucx / torch-ucc
  pytorch ucc plugin
  ☆18Updated 3 years ago
• kanonjz / paper
  Machine Learning System
  ☆14Updated 4 years ago
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆141Updated 4 years ago
• awslabs / lorien
  ☆44Updated last year
• facebookresearch / param
  PArametrized Recommendation and Ai Model benchmark is a repository for development of numerous uBenchmarks as well as end to end nets for…
  ☆128Updated this week
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆17Updated this week
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆54Updated 10 months ago