Alternatives and similar repositories for inference-client

Users that are interested in inference-client are comparing it to the libraries listed below

• aliyun / alibabacloud-aiacc-demo
  alibabacloud-aiacc-demo
  ☆43Updated 2 years ago
• kleveross / klever-model-registry
  Cloud Native Machine Learning Model Registry
  ☆82Updated 2 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆149Updated 5 years ago
• ucbrise / caravel
  Studying GPU Multi-tenancy
  ☆12Updated 6 years ago
• AlibabaIncubator / gpdb-faiss-vector
  本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。
  ☆23Updated 3 years ago
• Tencent / WeChat-TFCC
  ☆128Updated 4 years ago
• didiyun / didiyun-go-sdk
  滴滴云Golang开发者工具套件
  ☆14Updated 4 years ago
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆70Updated 2 years ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆185Updated 5 years ago
• kleveross / klever
  Cloud Native ML/DL Platform
  ☆133Updated 5 years ago
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆144Updated 3 years ago
• caicloud / ciao
  Kernel for Kubeflow in Jupyter Notebook
  ☆66Updated 6 years ago
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 6 months ago
• yandili / forge_load
  空闲GPU和CPU占用程序
  ☆37Updated last year
• pai-eas / eas-python-sdk
  ☆21Updated 2 months ago
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆60Updated last year
• kubeflow / mxnet-operator
  A Kubernetes operator for mxnet jobs
  ☆53Updated 3 years ago
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 4 years ago
• DeepRec-AI / serving
  A high-performance serving system for DeepRec based on TensorFlow Serving.
  ☆19Updated last year
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆84Updated 3 years ago
• FlYWMe / SearchServer
  一个基于 faiss 的检索服务.
  ☆49Updated 7 years ago
• PaddleFlow / paddle-operator
  Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano
  ☆32Updated 2 years ago
• elasticdeeplearning / edl
  Elastic Deep Learning for deep learning framework on Kubernetes
  ☆174Updated 2 years ago
• triton-inference-server / hugectr_backend
  ☆56Updated last year
• didiyun / dawnbench-ifx
  ☆10Updated 5 years ago
• houminz / paper-reading
  Paper Reading：涉及分布式、虚拟化、网络、机器学习
  ☆23Updated 4 years ago
• gpucloud / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆15Updated 6 years ago
• sql-machine-learning / pysqlflow
  SQLFlow client library for Python
  ☆29Updated 2 years ago
• markwwen / ServingAgent
  A simple middleware to improving GPU utilization then speedup online inference.
  ☆19Updated 4 years ago
• framely / ktqueue
  ☆56Updated 6 years ago