Alternatives and similar repositories for inference-client

Users that are interested in inference-client are comparing it to the libraries listed below

• didiyun / didiyun-go-sdk
  滴滴云Golang开发者工具套件
  ☆14Updated 5 years ago
• Tencent / WeChat-TFCC
  ☆127Updated 4 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆151Updated 6 years ago
• aliyun / alibabacloud-aiacc-demo
  alibabacloud-aiacc-demo
  ☆43Updated 2 years ago
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆144Updated 4 years ago
• kleveross / klever-model-registry
  Cloud Native Machine Learning Model Registry
  ☆82Updated 2 years ago
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 10 months ago
• didiyun / dawnbench-ifx
  ☆11Updated 5 years ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆187Updated 5 years ago
• FlYWMe / SearchServer
  一个基于 faiss 的检索服务.
  ☆49Updated 7 years ago
• pai-eas / eas-python-sdk
  ☆21Updated last month
• AlibabaIncubator / gpdb-faiss-vector
  本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。
  ☆24Updated 3 years ago
• kleveross / klever
  Cloud Native ML/DL Platform
  ☆133Updated 5 years ago
• ucbrise / caravel
  Studying GPU Multi-tenancy
  ☆11Updated 6 years ago
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆70Updated 2 years ago
• DeepRec-AI / serving
  A high-performance serving system for DeepRec based on TensorFlow Serving.
  ☆19Updated 2 years ago
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 4 years ago
• yandili / forge_load
  空闲GPU和CPU占用程序
  ☆38Updated last year
• zhoubolei / GoSpark
  ☆77Updated 11 years ago
• AliyunContainerService / arena
  A CLI for Kubeflow.
  ☆60Updated 2 years ago
• triton-inference-server / hugectr_backend
  ☆56Updated 2 years ago
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 9 months ago
• vearch / gamma
  Real time vector search engine
  ☆139Updated 2 years ago
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆16Updated 2 years ago
• second-state / meetups
  ☆70Updated 9 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated 2 years ago
• OpenBMB / cpm_kernels
  ☆25Updated 2 years ago
• dyweb / cloudab
  Cloud-Native Feature Management & A/B Testing Platform (WIP) 云原生的 A/B 测试平台
  ☆36Updated 4 years ago
• PaddleFlow / paddle-operator
  Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano
  ☆32Updated 2 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 3 years ago