Alternatives and similar repositories for serving:

Users that are interested in serving are comparing it to the libraries listed below

• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆158Updated 8 months ago
• Angel-ML / serving
  A stand alone industrial serving system for angel.
  ☆62Updated 2 years ago
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆141Updated 3 years ago
• triton-inference-server / hugectr_backend
  ☆51Updated last year
• 4paradigm / OpenEmbedding
  OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
  ☆31Updated last year
• bytedance / primus
  ☆199Updated last year
• alibaba / nann
  A flexible, high-performance framework for large-scale retrieval problems based on TensorFlow.
  ☆153Updated 6 months ago
• Qihoo360 / tensornet
  ☆321Updated this week
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆90Updated last year
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆136Updated last week
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆181Updated 4 years ago
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 3 years ago
• bytedance / ps-lite
  A lightweight parameter server interface
  ☆75Updated 2 years ago
• kangshantong / ps-dnn
  这是一个基于参数服务器（Parameter Server）PS-Lite的分布式深度学习训练和预测框架。This is a model training and prediction framework.1) It includes a complete set of pr…
  ☆23Updated 2 years ago
• jony0917 / tensorflow-extend-framework
  tensorflow extend framework
  ☆13Updated 4 years ago
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆266Updated last year
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆59Updated last year
• volcengine / veGiantModel
  ☆211Updated last year
• xswang / xflow
  Distributed LR、 FM model on Parameter Server. FTRL and SGD Optimization Algorithm.
  ☆222Updated 6 years ago
• gctian / distributed-tensorflow
  some experiments for distributed tensorflow
  ☆20Updated 6 years ago
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆345Updated last month
• alibaba / FeatureGenerator
  ☆36Updated 3 years ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆190Updated 6 years ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆83Updated 2 years ago
• alibaba / pairec
  A Go web framework for quickly building recommendation online services based on JSON configuration.
  ☆73Updated this week
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆147Updated 5 years ago
• 4paradigm / openaios-platform
  OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development…
  ☆95Updated 3 years ago
• fukang93 / YCDL
  DNN framework based on ps-lite
  ☆30Updated 3 years ago
• 4paradigm / DemoApps
  demo applications that show how to deploy offline feature engineering solutions to online in one minute with fedb and nativespark
  ☆35Updated 3 months ago
• kubedl-io / morphling
  Automatic tuning for ML model deployment on Kubernetes
  ☆80Updated 2 months ago