Alternatives and similar repositories for serving:

Users that are interested in serving are comparing it to the libraries listed below

• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆157Updated last year
• Angel-ML / serving
  A stand alone industrial serving system for angel.
  ☆62Updated 3 years ago
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆142Updated 3 years ago
• triton-inference-server / hugectr_backend
  ☆53Updated last year
• alibaba / nann
  A flexible, high-performance framework for large-scale retrieval problems based on TensorFlow.
  ☆161Updated 3 months ago
• DeepRec-AI / extension
  DeepRec Extension is an easy-to-use, stable and efficient large-scale distributed training system based on DeepRec.
  ☆11Updated 11 months ago
• 4paradigm / OpenEmbedding
  OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
  ☆31Updated 2 years ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆94Updated 2 years ago
• bytedance / ps-lite
  A lightweight parameter server interface
  ☆76Updated 2 years ago
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆144Updated this week
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆183Updated 4 years ago
• Qihoo360 / tensornet
  a TensorFlow-based distributed training framework optimized for large-scale sparse data.
  ☆326Updated last week
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated 2 years ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆190Updated 6 years ago
• jony0917 / tensorflow-extend-framework
  tensorflow extend framework
  ☆13Updated 5 years ago
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆354Updated 5 months ago
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 3 years ago
• volcengine / veGiantModel
  ☆215Updated last year
• Tencent / WeChat-TFCC
  ☆127Updated 3 years ago
• alibaba / TorchEasyRec
  An easy-to-use framework for large scale recommendation algorithms.
  ☆151Updated this week
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆148Updated 5 years ago
• bytedance / primus
  ☆207Updated last year
• Tencent / embedx
  embedx 是基于 c++ 开发的、完全自研的分布式 embedding 训练和推理框架。它目前支持 图模型、深度排序、召回模型和图与排序、图与召回的联合训练模型等
  ☆309Updated 11 months ago
• xswang / xflow
  Distributed LR、 FM model on Parameter Server. FTRL and SGD Optimization Algorithm.
  ☆224Updated 7 years ago
• alibaba / FeatureGenerator
  ☆36Updated 3 years ago
• PaddlePaddle / Perf
  SOTA benchmark
  ☆18Updated last year
• Angel-ML / PyTorch-On-Angel
  PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.
  ☆167Updated 2 years ago
• flink-extended / clink
  Clink is a library that provides APIs and infrastructure to facilitate the development of parallelizable feature engineering operators th…
  ☆29Updated 3 years ago
• pai-eas / eas-python-sdk
  ☆21Updated 4 months ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆83Updated 3 years ago