markwwen / ServingAgent
A simple middleware to improving GPU utilization then speedup online inference.
☆19Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for ServingAgent
- Colab notebooks for d2l-book☆11Updated 4 years ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆13Updated 4 years ago
- Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"☆15Updated 5 years ago
- Some deep learning models written with mxnet and C++11.☆13Updated 6 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Updated 2 years ago
- Table Detection from the Given Pictures or Files☆15Updated 6 years ago
- ☆24Updated 6 years ago
- A PyTorch Dataset that caches samples in shared memory, accessible globally to all processes☆20Updated 2 years ago
- Contrast between ShuffleNet V2 and MnasNet.(Non-official implement In PyTorch)☆12Updated 6 years ago
- Easy Multiprocessing for Python☆43Updated 4 years ago
- List of papers that applied graph network to NLP☆13Updated 5 years ago
- MXNet supports distributed training enabling us to leverage multiple machines for faster training.☆12Updated 6 years ago
- profile tools for pytorch nn models☆42Updated 3 years ago
- multi-task classifier☆21Updated last year
- python image data augmentation☆13Updated 7 years ago
- gRPC server for hosting ML models trained on any framework in python☆78Updated last year
- Tensorflow Faster RCNN☆7Updated 7 years ago
- ContextLab: A Toolbox for Context Feature Augmentation developed with PyTorch☆39Updated 5 years ago
- Source code and checkpoints for legal pre-trained language models.☆15Updated 3 years ago
- 图片简易标注工具,标注类似ICDAR数据集,支持多边形标注,文本标注,方便OCR数据集标注。☆53Updated 5 years ago
- implement bert in pure c++☆31Updated 4 years ago
- Distributed DataLoader For Pytorch Based On Ray☆24Updated 3 years ago
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆13Updated 5 years ago
- This project demonstrates the use of generic bi-directional LSTM models for predicting importance of words in a spoken dialgoue for under…☆10Updated last year
- Various implementations and experimentation for deep neural network model compression☆24Updated 6 years ago