ml模型分布式服务部署：grpc，flask；docker
☆77Jan 5, 2021Updated 5 years ago
Alternatives and similar repositories for QDServing
Users that are interested in QDServing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 利用tensorflow/serving进行单模型、多模型、同一模型多版本的部署，并进行模型预测，并用Prothemus进行服务监控。☆11Feb 24, 2021Updated 5 years ago
- 通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆416Dec 21, 2021Updated 4 years ago
- This project related to one of my B.Tech final year project that investigates the influence of linguistic and sentiment analysis features…☆14Oct 22, 2023Updated 2 years ago
- 使用TensorRT部署SlowFast模型☆24Mar 2, 2022Updated 4 years ago
- Face Scoring Model to Get the Beauty Score of Face☆24Dec 18, 2018Updated 7 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- The fundamental package for scientific research in optimization.☆28Aug 25, 2026Updated 3 weeks ago
- Implementation and Deployment of Multilingual Custom Keyword Spotting Running in Real-time on an Edge Device.☆11Apr 27, 2023Updated 3 years ago
- BERT模型从训练到部署☆530Sep 23, 2020Updated 5 years ago
- Tengine 管子是用来快速生产 demo 的辅助工具☆11Jul 15, 2021Updated 5 years ago
- Feedforward Sequential Memory Networks☆18Aug 2, 2022Updated 4 years ago
- ☆10Jun 13, 2023Updated 3 years ago
- 使用ONNXRuntime部署anchor-free系列的YOLOR，包含C++和Python两种版本的程序☆40Sep 18, 2021Updated 5 years ago
- Flutter下拉选择菜单☆13Jan 30, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official PyTorch implementation of "Attention-Free Keyword Spotting", Mashrur. M. Morshed & Ahmad Omar Ahsan, PML4DC @ ICLR 2022.☆15Nov 5, 2022Updated 3 years ago
- ☆15May 29, 2021Updated 5 years ago
- ☆14Feb 3, 2022Updated 4 years ago
- implementation of lodash library in Go 1.18 generics [WIP]☆12Apr 29, 2022Updated 4 years ago
- BERT distillation（基于BERT的蒸馏实验 ）☆317Jul 30, 2020Updated 6 years ago
- 2020中兴捧月阿尔法赛道多目标检测和跟踪初赛第一名方案☆33Oct 3, 2023Updated 2 years ago
- fixed-point, symmetric, power-of-2 quantization-aware training in tensorflow 1.13.1☆12May 24, 2019Updated 7 years ago
- 服务侧深度学习部署案例☆455Mar 27, 2020Updated 6 years ago
- 口罩检测。凑个热闹，和百度类似的是否佩戴口罩检测分类，但是速度会更快。☆29Jul 25, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆282Jun 2, 2022Updated 4 years ago
- using python and flask for ocr annotation web tool☆25Jan 7, 2020Updated 6 years ago
- 记录有用的Git repos☆12Jul 28, 2024Updated 2 years ago
- Script to read frames from the camera using multithreading Python☆15Apr 18, 2019Updated 7 years ago
- 算子库（Rust）☆15Jul 24, 2025Updated last year
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- ☆12Aug 11, 2019Updated 7 years ago
- ☆14Jun 8, 2020Updated 6 years ago
- Knowledge Distillation Toolbox for Semantic Segmentation☆17Nov 20, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Base on retinaface and centerface modefied. frame work depend on pytorch.☆31Jul 23, 2020Updated 6 years ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆14May 29, 2020Updated 6 years ago
- A project demonstration to do the industrial defect segmentation based on loading the image from directory and generate the output ground…☆11Jun 27, 2024Updated 2 years ago
- basic algorithm☆11Nov 28, 2020Updated 5 years ago
- 比赛相关的实践☆21Sep 18, 2019Updated 7 years ago
- Deploy Your First Deep Learning Model On Kubernetes With Python, Keras, Flask, and Docker 使用 Kubernetes 轻松部署深度学习模型☆11Oct 15, 2018Updated 7 years ago
- 开箱即用，支持windows, ubuntu和mac☆263Jul 24, 2023Updated 3 years ago