Alternatives and similar repositories for inference-client

Users that are interested in inference-client are comparing it to the libraries listed below

• Tencent / WeChat-TFCC
  ☆127Updated 4 years ago
• aliyun / alibabacloud-aiacc-demo
  alibabacloud-aiacc-demo
  ☆43Updated 2 years ago
• ucbrise / caravel
  Studying GPU Multi-tenancy
  ☆12Updated 6 years ago
• didiyun / didiyun-go-sdk
  滴滴云Golang开发者工具套件
  ☆14Updated 4 years ago
• tensorchord / modelz-ChatGLM
  Deploy ChatGLM on Modelz
  ☆16Updated 2 years ago
• layerism / brpc_faiss_server
  Vector Search Engine base on BRPC + FAISS
  ☆149Updated 5 years ago
• iqiyi / xgboost-serving
  A flexible, high-performance serving system for machine learning models
  ☆144Updated 3 years ago
• didiyun / dawnbench-ifx
  ☆10Updated 5 years ago
• PaddlePaddle / ElasticCTR
  ElasticCTR，即飞桨弹性计算推荐系统，是基于Kubernetes的企业级推荐系统开源解决方案。该方案融合了百度业务场景下持续打磨的高精度CTR模型、飞桨开源框架的大规模分布式训练能力、工业级稀疏参数弹性调度服务，帮助用户在Kubernetes环境中一键完成推荐系统部…
  ☆185Updated 5 years ago
• tobegit3hub / tfmodel
  Statically and dynamically inspect tool for TensorFlow models
  ☆24Updated 6 years ago
• AlibabaIncubator / gpdb-faiss-vector
  本插件是将faiss集成到greenplum数据库中，以提供向量召回的能力。
  ☆23Updated 3 years ago
• tensorchord / ai-infra-statistics
  This repository contains statistics about the AI Infrastructure products.
  ☆17Updated 7 months ago
• kleveross / klever-model-registry
  Cloud Native Machine Learning Model Registry
  ☆82Updated 2 years ago
• kleveross / ftlib
  Fault-tolerant for DL frameworks
  ☆70Updated 2 years ago
• gpucloud / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆15Updated 6 years ago
• alibaba / FastNN
  FastNN provides distributed training examples that use EPL.
  ☆84Updated 3 years ago
• tencentyun / chdfs-hadoop-plugin
  the hadoop plugin for chdfs
  ☆10Updated last month
• vearch / gamma
  Real time vector search engine
  ☆138Updated 2 years ago
• caicloud / ciao
  Kernel for Kubeflow in Jupyter Notebook
  ☆66Updated 6 years ago
• FlYWMe / SearchServer
  一个基于 faiss 的检索服务.
  ☆49Updated 7 years ago
• kubeflow / mxnet-operator
  A Kubernetes operator for mxnet jobs
  ☆53Updated 3 years ago
• y123456yz / reading-and-annotate-docker-17.05.0
  docker-17.05.0 containerd opencontainers/runc lxc mesos源码中文注释详细分析，带详细注释说明，学习容器技术很有帮助，近期持续更新
  ☆64Updated 5 years ago
• yandili / forge_load
  空闲GPU和CPU占用程序
  ☆37Updated last year
• triton-inference-server / hugectr_backend
  ☆56Updated last year
• kleveross / klever
  Cloud Native ML/DL Platform
  ☆133Updated 5 years ago
• yubo1911 / saber
  A collection of sabers to do kinds of trivial stuff.
  ☆25Updated 7 years ago
• zijie0 / cloud_ml_platform
  ☆35Updated 4 years ago
• Qihoo360 / dgl-operator
  The DGL Operator makes it easy to run Deep Graph Library (DGL) graph neural network training on Kubernetes
  ☆44Updated 4 years ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated 2 years ago
• Crisescode / distributed-training-dl
  各种深度学习（DL）框架分布式训练，包括：Tensorflow、Tensorflow2、Pytorch、Chainer、Caffe、Mxnet ...
  ☆21Updated 5 years ago