Alternatives and similar repositories for serving:

Users that are interested in serving are comparing it to the libraries listed below

• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆157Updated 9 months ago
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆141Updated 3 years ago
• Angel-ML / serving
  A stand alone industrial serving system for angel.
  ☆62Updated 2 years ago
• alibaba / nann
  A flexible, high-performance framework for large-scale retrieval problems based on TensorFlow.
  ☆155Updated 3 weeks ago
• triton-inference-server / hugectr_backend
  ☆51Updated last year
• Qihoo360 / tensornet
  ☆322Updated last week
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆90Updated last year
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆138Updated this week
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆181Updated 4 years ago
• bytedance / primus
  ☆201Updated last year
• alibaba / pairec
  A Go web framework for quickly building recommendation online services based on JSON configuration.
  ☆75Updated this week
• 4paradigm / OpenEmbedding
  OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
  ☆31Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆266Updated last year
• bytedance / ps-lite
  A lightweight parameter server interface
  ☆75Updated 2 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆147Updated 5 years ago
• DeepRec-AI / extension
  DeepRec Extension is an easy-to-use, stable and efficient large-scale distributed training system based on DeepRec.
  ☆10Updated 8 months ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆190Updated 6 years ago
• xswang / xflow
  Distributed LR、 FM model on Parameter Server. FTRL and SGD Optimization Algorithm.
  ☆222Updated 6 years ago
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆346Updated 2 months ago
• PaddlePaddle / Perf
  SOTA benchmark
  ☆18Updated last year
• Tencent / embedx
  embedx 是基于 c++ 开发的、完全自研的分布式 embedding 训练和推理框架。它目前支持 图模型、深度排序、召回模型和图与排序、图与召回的联合训练模型等
  ☆302Updated 8 months ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆83Updated 2 years ago
• Angel-ML / PyTorch-On-Angel
  PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.
  ☆167Updated 2 years ago
• lambdaji / DarwinAccelerator
  Google分层实验框架
  ☆29Updated 6 years ago
• fukang93 / YCDL
  DNN framework based on ps-lite
  ☆30Updated 3 years ago
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆69Updated last year
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 3 years ago
• volcengine / veGiantModel
  ☆213Updated last year
• Tencent / WeChat-TFCC
  ☆125Updated 3 years ago
• alibaba / FeatureGenerator
  ☆36Updated 3 years ago