Alternatives and similar repositories for serving

Users that are interested in serving are comparing it to the libraries listed below

• DeepRec-AI / HybridBackend
  A high-performance framework for training wide-and-deep recommender systems on heterogeneous cluster
  ☆158Updated last year
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆143Updated 3 years ago
• triton-inference-server / hugectr_backend
  ☆55Updated last year
• Qihoo360 / tensornet
  a TensorFlow-based distributed training framework optimized for large-scale sparse data.
  ☆327Updated 2 weeks ago
• Angel-ML / serving
  A stand alone industrial serving system for angel.
  ☆62Updated 3 years ago
• alibaba / nann
  A flexible, high-performance framework for large-scale retrieval problems based on TensorFlow.
  ☆165Updated 5 months ago
• bytedance / primus
  ☆216Updated 2 years ago
• alibaba / proxima
  ☆400Updated 2 years ago
• NVIDIA-Merlin / HierarchicalKV
  HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of…
  ☆156Updated 2 weeks ago
• 4paradigm / OpenEmbedding
  OpenEmbedding is an open source framework for Tensorflow distributed training acceleration.
  ☆32Updated 2 years ago
• tengkz / tensorflow_notes
  tensorflow源码阅读笔记
  ☆191Updated 6 years ago
• baidu / puck
  Puck is a high-performance ANN search engine
  ☆360Updated last month
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆94Updated 2 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆148Updated 5 years ago
• DeepRec-AI / extension
  DeepRec Extension is an easy-to-use, stable and efficient large-scale distributed training system based on DeepRec.
  ☆11Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆267Updated 2 years ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆185Updated 5 years ago
• xswang / xflow
  Distributed LR、 FM model on Parameter Server. FTRL and SGD Optimization Algorithm.
  ☆224Updated 7 years ago
• alibaba / FeatureGenerator
  ☆37Updated 3 years ago
• jony0917 / tensorflow-extend-framework
  tensorflow extend framework
  ☆13Updated 5 years ago
• bytedance / ps-lite
  A lightweight parameter server interface
  ☆76Updated 2 years ago
• Tencent / deepx_core
  deepx_core是一个专注于张量计算/深度学习的基础库
  ☆377Updated 2 months ago
• Tencent / WeChat-TFCC
  ☆127Updated 4 years ago
• volcengine / veGiantModel
  ☆220Updated last year
• Tencent / embedx
  embedx 是基于 c++ 开发的、完全自研的分布式 embedding 训练和推理框架。它目前支持 图模型、深度排序、召回模型和图与排序、图与召回的联合训练模型等
  ☆311Updated last year
• DeepRec-AI / DeepRec
  DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foun…
  ☆1,110Updated 5 months ago
• alibaba / pairec
  A Go web framework for quickly building recommendation online services based on JSON configuration.
  ☆101Updated this week
• zhihu / TLLM_QMM
  TLLM_QMM strips the implementation of quantized kernels of Nvidia's TensorRT-LLM, removing NVInfer dependency and exposes ease of use Pyt…
  ☆16Updated last year
• linkedin / spark-tfrecord
  Read and write Tensorflow TFRecord data from Apache Spark.
  ☆293Updated last year
• alibaba / feathub
  FeatHub - A stream-batch unified feature store for real-time machine learning
  ☆335Updated last year