emacski / tensorflow-serving-arm
TensorFlow Serving ARM - A project for cross-compiling TensorFlow Serving targeting popular ARM cores
☆101Updated 3 years ago
Alternatives and similar repositories for tensorflow-serving-arm:
Users that are interested in tensorflow-serving-arm are comparing it to the libraries listed below
- A prebuilt tensorflow serving client from the tensorflow serving proto files☆37Updated 11 months ago
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆590Updated this week
- Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response☆147Updated last year
- Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints☆154Updated 3 months ago
- Python SDK for building, training, and deploying ML models☆336Updated 2 years ago
- TensorFlow wheels (whl) for aarch64 / ARMv8 / ARM64☆136Updated last year
- For recording and retrieving metadata associated with ML developer and data scientist workflows.☆633Updated 3 months ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆581Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆448Updated 2 weeks ago
- Elasticsearch plugin for nearest neighbor search. Store vectors and run similarity search using exact and approximate algorithms.☆379Updated 2 weeks ago
- Convert tf.keras/Keras models to ONNX☆380Updated 3 years ago
- PyTorch on Kubernetes☆308Updated 3 years ago
- Automated Machine Learning on Kubernetes☆1,535Updated this week
- Examples for Kubeflow and Kubeflow pipelines☆54Updated 5 years ago
- DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps☆401Updated last year
- Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times☆88Updated 2 years ago
- 🆕 A machine learning plugin which supports an approximate k-NN search algorithm for Open Distro.☆279Updated 3 years ago
- Tensorflow Backend for ONNX☆1,291Updated 10 months ago
- The Triton backend for the ONNX Runtime.☆136Updated last week
- java native interface for faiss☆40Updated 4 years ago
- User documentation for KServe.☆103Updated this week
- A CLI for Kubeflow.☆745Updated this week
- Python client for RedisAI☆89Updated last year
- ONNXMLTools enables conversion of models to ONNX☆1,042Updated 3 weeks ago
- Kubeflow’s superfood for Data Scientists☆631Updated 2 years ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆193Updated 2 weeks ago
- A scalable inference server for models optimized with OpenVINO™☆701Updated this week
- Generic and easy-to-use serving service for machine learning models☆757Updated 4 years ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆452Updated 2 weeks ago
- Plugin to integrate approximate nearest neighbor(ANN) search with Elasticsearch☆65Updated 6 years ago