Alternatives and similar repositories for tensorflow-serving-arm

Users that are interested in tensorflow-serving-arm are comparing it to the libraries listed below

• triton-inference-server / client
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
  ☆660Updated this week
• tobegit3hub / simple_tensorflow_serving
  Generic and easy-to-use serving service for machine learning models
  ☆761Updated 8 months ago
• KumaTea / tensorflow-aarch64
  TensorFlow wheels (whl) for aarch64 / ARMv8 / ARM64
  ☆139Updated 2 years ago
• triton-inference-server / python_backend
  Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
  ☆655Updated this week
• openvinotoolkit / model_server
  A scalable inference server for models optimized with OpenVINO™
  ☆790Updated this week
• figroc / tensorflow-serving-client
  A prebuilt tensorflow serving client from the tensorflow serving proto files
  ☆38Updated 9 months ago
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆496Updated this week
• onnx / onnxmltools
  ONNXMLTools enables conversion of models to ONNX
  ☆1,124Updated 5 months ago
• onnx / onnx-tensorflow
  Tensorflow Backend for ONNX
  ☆1,325Updated last year
• tensorflow / tensorrt
  TensorFlow/TensorRT integration
  ☆744Updated last year
• autodeployai / ai-serving
  Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
  ☆163Updated 2 weeks ago
• tensorflow / io
  Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO
  ☆734Updated 2 months ago
• NVIDIA / nvidia-container-runtime
  NVIDIA container runtime
  ☆1,124Updated 2 years ago
• kubeflow / katib
  Automated Machine Learning on Kubernetes
  ☆1,641Updated this week
• onnx / onnx-docker
  Dockerfiles and scripts for ONNX container images
  ☆138Updated 3 years ago
• kserve / modelmesh
  Distributed Model Serving Framework
  ☆178Updated last month
• kubeflow / pytorch-operator
  PyTorch on Kubernetes
  ☆309Updated 3 years ago
• junwan01 / tensorflow-serve-client
  A Java Client for TenforFlow Serving gRPC API
  ☆36Updated 6 years ago
• RedisAI / redis-inference-optimization
  A Redis module for serving tensors and executing deep learning graphs
  ☆841Updated 3 months ago
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆241Updated 5 months ago
• kubeflow / manifests
  Kubeflow Deployment Manifests
  ☆962Updated this week
• triton-inference-server / pytriton
  PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
  ☆825Updated 3 months ago
• awslabs / multi-model-server
  Multi Model Server is a tool for serving neural net models for inference
  ☆1,024Updated last year
• kubeflow / kfctl
  kfctl is a CLI for deploying and managing Kubeflow
  ☆184Updated 2 years ago
• kaiwaehner / tensorflow-serving-java-grpc-kafka-streams
  Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response
  ☆150Updated last year
• milvus-io / milvus-insight
  Milvus management GUI
  ☆97Updated 3 years ago
• ShannonAI / service-streamer
  Boosting your Web Services of Deep Learning Applications.
  ☆1,244Updated 4 years ago
• tensorflow / tfx
  TFX is an end-to-end platform for deploying production ML pipelines
  ☆2,169Updated 3 weeks ago
• thenetcircle / faiss4j
  java wrapper for facebook faiss
  ☆43Updated 5 years ago
• kserve / website
  User documentation for KServe.
  ☆109Updated last week