Alternatives and similar repositories for serving:

Users that are interested in serving are comparing it to the libraries listed below

• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆157Updated 11 months ago
• triton-inference-server / hugectr_backend
  ☆52Updated last year
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆142Updated 3 years ago
• Angel-ML / serving
  A stand alone industrial serving system for angel.
  ☆62Updated 3 years ago
• DeepRec-AI / extension
  DeepRec Extension is an easy-to-use, stable and efficient large-scale distributed training system based on DeepRec.
  ☆11Updated 11 months ago
• Qihoo360 / tensornet
  a TensorFlow-based distributed training framework optimized for large-scale sparse data.
  ☆323Updated this week
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆183Updated 4 years ago
• 4paradigm / OpenEmbedding
  OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
  ☆31Updated 2 years ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆94Updated last year
• alibaba / nann
  A flexible, high-performance framework for large-scale retrieval problems based on TensorFlow.
  ☆161Updated 2 months ago
• bytedance / primus
  ☆205Updated last year
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆142Updated 2 weeks ago
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 3 years ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆190Updated 6 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆148Updated 5 years ago
• bytedance / ps-lite
  A lightweight parameter server interface
  ☆76Updated 2 years ago
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆60Updated last year
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆70Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated 2 years ago
• volcengine / veGiantModel
  ☆214Updated last year
• alibaba / TorchEasyRec
  An easy-to-use framework for large scale recommendation algorithms.
  ☆139Updated this week
• alibaba / pairec
  A Go web framework for quickly building recommendation online services based on JSON configuration.
  ☆83Updated this week
• kubedl-io / morphling
  Automatic tuning for ML model deployment on Kubernetes
  ☆81Updated 5 months ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆83Updated 3 years ago
• xswang / xflow
  Distributed LR、 FM model on Parameter Server. FTRL and SGD Optimization Algorithm.
  ☆224Updated 7 years ago
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆351Updated 4 months ago
• Angel-ML / PyTorch-On-Angel
  PyTorch On Angel, arming PyTorch with a powerful Parameter Server, which enable PyTorch to train very big models.
  ☆167Updated 2 years ago
• 4paradigm / openaios-platform
  OpenAIOS is an incubating open-source distributed OS kernel based on Kubernetes for AI workloads. OpenAIOS-Platform is an AI development…
  ☆97Updated 3 years ago
• 4paradigm / DemoApps
  demo applications that show how to deploy offline feature engineering solutions to online in one minute with fedb and nativespark
  ☆35Updated 6 months ago
• lambdaji / DarwinAccelerator
  Google分层实验框架
  ☆29Updated 6 years ago