Alternatives and similar repositories for awesome-ml-infra

Users that are interested in awesome-ml-infra are comparing it to the libraries listed below

• ucbrise / cs294-ai-sys-sp19
  CS294; AI For Systems and Systems For AI
  ☆224Updated 5 years ago
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆152Updated this week
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆70Updated last year
• bytedance / ps-lite
  A lightweight parameter server interface
  ☆76Updated 2 years ago
• triton-inference-server / hugectr_backend
  ☆53Updated last year
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 3 years ago
• SymbioticLab / Salus
  Fine-grained GPU sharing primitives
  ☆141Updated 5 years ago
• netx-repo / PipeSwitch
  PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications
  ☆126Updated 3 years ago
• alibaba / GPU-scheduler-for-deep-learning
  GPU-scheduler-for-deep-learning
  ☆207Updated 4 years ago
• PaddleFlow / ElasticServing
  Elastic Serverless Serving based on Kubernetes, provides 0 instance serving capability.
  ☆11Updated 3 years ago
• kubedl-io / morphling
  Automatic tuning for ML model deployment on Kubernetes
  ☆80Updated 7 months ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆191Updated 6 years ago
• 4paradigm / OpenEmbedding
  OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
  ☆32Updated 2 years ago
• zw0610 / zw0610.github.io
  ☆58Updated 4 years ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆94Updated 2 years ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated 2 years ago
• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆158Updated last year
• PaddleFlow / paddle-operator
  Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano
  ☆32Updated 2 years ago
• kzhang28 / Optimus
  An Efficient Dynamic Resource Scheduler for Deep Learning Clusters
  ☆42Updated 7 years ago
• google / nccl-fastsocket
  NCCL Fast Socket is a transport layer plugin to improve NCCL collective communication performance on Google Cloud.
  ☆117Updated last year
• BaguaSys / bagua-core
  Core communication lib for Bagua.
  ☆48Updated 3 years ago
• mcanini / SysML-reading-list
  Systems for ML/AI & ML/AI for Systems paper reading list: A curated reading list of computer science research for work at the intersectio…
  ☆275Updated 2 weeks ago
• dlsys-course / tinyflow
  Tutorial code on how to build your own Deep Learning System in 2k Lines
  ☆125Updated 8 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆285Updated 3 years ago
• quiver-team / quiver-feature
  High performance RDMA-based distributed feature collection component for training GNN model on EXTREMELY large graph
  ☆54Updated 2 years ago
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆87Updated last month
• byteps / examples
  BytePS examples (Vision, NLP, GAN, etc)
  ☆19Updated 2 years ago
• ucbrise / cs294-ai-sys-fa19
  CS294-162; Machine Learning Systems Seminar
  ☆31Updated 2 years ago
• yalue / cuda_scheduling_examiner_mirror
  A tool for examining GPU scheduling behavior.
  ☆84Updated 10 months ago
• bytedance-iaas / splitwise-demos
  ☆26Updated 3 months ago