markwwen / ServingAgentLinks
A simple middleware to improving GPU utilization then speedup online inference.
☆19Updated 4 years ago
Alternatives and similar repositories for ServingAgent
Users that are interested in ServingAgent are comparing it to the libraries listed below
Sorting:
- gRPC server for hosting ML models trained on any framework in python☆78Updated 4 months ago
- Easy Multiprocessing for Python☆42Updated 5 years ago
- Colab notebooks for d2l-book☆11Updated 6 years ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆13Updated 5 years ago
- 图片简易标注工具,标注类似ICDAR数据集,支持多边形标注,文本标注,方便OCR数据集标注。☆55Updated 6 years ago
- Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"☆14Updated 6 years ago
- Similarity search engine built around Faiss library☆78Updated 3 years ago
- List of papers that applied graph network to NLP☆13Updated 6 years ago
- RAdam optimizer for keras☆71Updated 6 years ago
- Automatically build the deep learning models with ENAS☆31Updated 7 years ago
- Implementation of Neural Arithmetic Logic Units (https://arxiv.org/pdf/1808.00508.pdf)☆31Updated 7 years ago
- 以孤立语假设和宽度优先搜索为基础,构建了一种多通道堆叠注意力Transformer结构的斗地主ai☆94Updated 4 years ago
- Ranking made easy☆36Updated 6 years ago
- A pytorch based classification experiments template☆47Updated 4 years ago
- Implementation for <Neural Similarity Learning> in NeurIPS'19.☆33Updated 5 years ago
- tunz's CUDA pytorch operator (MaskedSoftmax)☆75Updated 6 years ago
- ☆26Updated 6 years ago
- ☆108Updated 4 years ago
- The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…☆48Updated 4 years ago
- tf2.0 implementation of circle loss☆32Updated 5 years ago
- Implementation in pytorch of SR-NMT https://arxiv.org/abs/1805.04185v1☆26Updated 7 years ago
- ☆13Updated 7 years ago
- pytorch during training, libtorch during serving via gRPC☆21Updated 6 years ago
- AutoTorch, A HPO Toolkit☆60Updated 5 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Updated 3 years ago
- State-of-the-art data augmentation search algorithms in PyTorch☆47Updated 2 years ago
- A Keras inspired training utility for PyTorch☆38Updated 7 years ago
- profile tools for pytorch nn models☆42Updated 4 years ago
- ☆54Updated 5 years ago
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 8 years ago