cjermain / flink-onnx-pytorch
Streaming machine learning using PyTorch, Flink, and ONNX
☆23Updated 3 years ago
Related projects: ⓘ
- ForestFlow is a policy-driven Machine Learning Model Server. It is an LF AI Foundation incubation project.☆71Updated 7 months ago
- MLFlow Deployment Plugin for Ray Serve☆41Updated 2 years ago
- Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on sing…☆23Updated last year
- An open source python library for automated prediction engineering☆45Updated this week
- AutoML - Hyper parameters search for scikit-learn pipelines using Microsoft NNI☆23Updated last year
- Kafka Streams + Java + gRPC + TensorFlow Serving => Stream Processing combined with RPC / Request-Response☆145Updated 9 months ago
- A high performance similariy search service with faiss inside.☆27Updated 6 years ago
- ☆48Updated 6 years ago
- Code for KDD CUP 2019 Auto-ML track☆21Updated 5 years ago
- A simple middleware to improving GPU utilization then speedup online inference.☆19Updated 3 years ago
- Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints☆144Updated 2 weeks ago
- ☆53Updated this week
- AIBench, a tool for comparing and evaluating AI serving solutions. forked from [tsbs](https://github.com/timescale/tsbs) and adapted to A…☆20Updated 2 weeks ago
- A JVM interface 🌯 for LightGBM, written in Scala, for inference in production.☆14Updated last week
- Model management example using Polyaxon, Argo and Seldon☆23Updated 5 years ago
- ☆15Updated last year
- FIL backend for the Triton Inference Server☆68Updated this week
- gRPC server over a FAISS index☆16Updated 3 years ago
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Updated last year
- Easy converter pandas -> tfrecords & tfrecords -> pandas☆37Updated last year
- Proof of concept on how to use TensorFlow for prediction tasks in a multiprocess setting.☆17Updated 5 years ago
- Kubeflow example of machine learning/model serving☆35Updated 4 years ago
- Similarity search engine built around Faiss library☆76Updated last year
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- GraphPipe for python☆42Updated 5 years ago
- A machine learning competition in Automated Deep Learning (AutoDL), co-organized by ChaLearn, Google and 4Paradigm. Accepted at NeurIPS 2…☆22Updated 3 years ago
- ☆32Updated 3 years ago
- Open Benchmarks for Evaluating the Performance of Feature Stores☆34Updated 6 months ago
- TensorFlow Serving benchmark☆33Updated 6 years ago
- Ray - A curated list of resources: https://github.com/ray-project/ray☆33Updated 10 months ago