markwwen / ServingAgentLinks
A simple middleware to improving GPU utilization then speedup online inference.
☆19Updated 4 years ago
Alternatives and similar repositories for ServingAgent
Users that are interested in ServingAgent are comparing it to the libraries listed below
Sorting:
- gRPC server for hosting ML models trained on any framework in python☆78Updated 5 months ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆13Updated 5 years ago
- Colab notebooks for d2l-book☆11Updated 6 years ago
- 图片简易标注工具,标注类似ICDAR数据集,支持多边形标注,文本标注,方便OCR数据集标注。☆56Updated 6 years ago
- Deep Neural Network Compression based on Student-Teacher Network☆14Updated 2 years ago
- The official implementation of You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Natu…☆48Updated 4 years ago
- Easy Multiprocessing for Python☆42Updated 5 years ago
- Similarity search engine built around Faiss library☆78Updated 3 years ago
- code scripts for blog posts I published☆13Updated 5 years ago
- Code for the paper "Understanding the Role of Momentum in Stochastic Gradient Methods"☆14Updated 6 years ago
- Implementation of Neural Arithmetic Logic Units (https://arxiv.org/pdf/1808.00508.pdf)☆31Updated 7 years ago
- Automatically build the deep learning models with ENAS☆31Updated 7 years ago
- RAdam optimizer for keras☆71Updated 6 years ago
- tunz's CUDA pytorch operator (MaskedSoftmax)☆75Updated 6 years ago
- ☆13Updated 7 years ago
- ☆26Updated 6 years ago
- ☆33Updated last year
- ☆54Updated 5 years ago
- AutoTorch, A HPO Toolkit☆60Updated 5 years ago
- Pytorch implementation of Quadratic Additive Angular Margin Loss for Face Recognition☆35Updated 5 years ago
- Source code and checkpoints for legal pre-trained language models.☆15Updated 4 years ago
- A pytorch based classification experiments template☆47Updated 4 years ago
- Implementation for <Neural Similarity Learning> in NeurIPS'19.☆33Updated 5 years ago
- Ranking made easy☆36Updated 7 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Updated 3 years ago
- bert4keras实现gpt下中国象棋☆47Updated 5 years ago
- Knowledge Distillation Toolkit☆89Updated 5 years ago
- A PyTorch implementation of our proposed loss function from the paper "SimLoss: Class Similarities in Cross Entropy"☆25Updated 4 years ago
- Implement DNN or ML models and advanced policies with PyTorch.(Include experiment)☆11Updated 6 years ago
- 以孤立语假设和宽度优先搜索为基础,构建了一种多通道堆叠注意力Transformer结构的斗地主ai☆94Updated 4 years ago