markwwen / ServingAgentLinks
A simple middleware to improving GPU utilization then speedup online inference.
☆19Updated 4 years ago
Alternatives and similar repositories for ServingAgent
Users that are interested in ServingAgent are comparing it to the libraries listed below
Sorting:
- gRPC server for hosting ML models trained on any framework in python☆78Updated 6 months ago
- Easy Multiprocessing for Python☆42Updated 5 years ago
- 图片简易标注工具,标注类似ICDAR数据集,支持多边形标注,文本标注,方便OCR数据集标注。☆56Updated 6 years ago
- Colab notebooks for d2l-book☆11Updated 6 years ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆13Updated 5 years ago
- Similarity search engine built around Faiss library☆78Updated 3 years ago
- 以孤立语假设和宽度优先搜索为基础,构建了一种多通道堆叠注意力Transformer结构的斗地主ai☆94Updated 4 years ago
- RAdam optimizer for keras☆71Updated 6 years ago
- A pytorch based classification experiments template☆47Updated 4 years ago
- ☆54Updated 5 years ago
- PyTorch 1.0 inference in C++ on Windows10 platforms☆89Updated 7 years ago
- tunz's CUDA pytorch operator (MaskedSoftmax)☆75Updated 6 years ago
- pytorch during training, libtorch during serving via gRPC☆21Updated 6 years ago
- Implementation of Neural Arithmetic Logic Units (https://arxiv.org/pdf/1808.00508.pdf)☆31Updated 7 years ago
- Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"☆14Updated 6 years ago
- Automatically build the deep learning models with ENAS☆31Updated 7 years ago
- Ranking made easy☆36Updated 7 years ago
- All Model summary in PyTorch similar to `model.summary()` in Keras☆88Updated 6 years ago
- ☆26Updated 6 years ago
- CV deeplearning demo☆102Updated 2 years ago
- 面试常见知识点整理☆11Updated 6 years ago
- bert4keras实现gpt下中国象棋☆46Updated 5 years ago
- List of papers that applied graph network to NLP☆13Updated 6 years ago
- AutoTorch, A HPO Toolkit☆60Updated 5 years ago
- A mxnet object detection library contains implementations of RFCN, FCOS, RetinaNet, OpenPose, etc..☆31Updated 5 years ago
- PyTorch DataLoader processed in multiple remote computation machines for heavy data processings☆68Updated 6 years ago
- Implementation in pytorch of SR-NMT https://arxiv.org/abs/1805.04185v1☆26Updated 7 years ago
- ☆24Updated 7 years ago
- Slides from various talks I gave☆18Updated 7 years ago
- Arxiv Sanity with novel paper search☆41Updated 6 years ago