markwwen / ServingAgentLinks
A simple middleware to improving GPU utilization then speedup online inference.
☆19Updated 4 years ago
Alternatives and similar repositories for ServingAgent
Users that are interested in ServingAgent are comparing it to the libraries listed below
Sorting:
- gRPC server for hosting ML models trained on any framework in python☆78Updated last year
- Colab notebooks for d2l-book☆11Updated 5 years ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".