ml模型分布式服务部署:grpc,flask;docker
☆77Jan 5, 2021Updated 5 years ago
Alternatives and similar repositories for QDServing
Users that are interested in QDServing are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 利用tensorflow/serving进行单模型、多模型、同一模型多版本的部署,并进行模型预测,并用Prothemus进行服务监控。☆11Feb 24, 2021Updated 5 years ago
- 通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆417Dec 21, 2021Updated 4 years ago
- 使用TensorRT部署SlowFast模型☆24Mar 2, 2022Updated 4 years ago
- ☆22Mar 26, 2018Updated 8 years ago
- ☆14Jan 29, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- The fundamental package for scientific research in optimization.☆27Updated this week
- BERT模型从训练到部署☆529Sep 23, 2020Updated 5 years ago
- Tengine 管子是用来快速生产 demo 的辅助工具☆11Jul 15, 2021Updated 5 years ago
- ☆10Jun 13, 2023Updated 3 years ago
- 使用ONNXRuntime部署anchor-free系列的YOLOR,包含C++和Python两种版本的程序☆41Sep 18, 2021Updated 4 years ago
- Flutter下拉选择菜单☆13Jan 30, 2023Updated 3 years ago
- ☆14Feb 3, 2022Updated 4 years ago
- implementation of lodash library in Go 1.18 generics [WIP]☆12Apr 29, 2022Updated 4 years ago
- BERT distillation(基于BERT的蒸馏实验 )☆317Jul 30, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 2020中兴捧月阿尔法赛道多 目标检测和跟踪初赛第一名方案☆33Oct 3, 2023Updated 2 years ago
- graphx example☆24Jan 23, 2016Updated 10 years ago
- fixed-point, symmetric, power-of-2 quantization-aware training in tensorflow 1.13.1☆12May 24, 2019Updated 7 years ago
- 服务侧深度 学习部署案例☆453Mar 27, 2020Updated 6 years ago
- 口罩检测。凑个热闹,和百度类似的是否佩戴口罩检测分类,但是速度会更快。☆29Jul 25, 2024Updated last year
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆283Jun 2, 2022Updated 4 years ago
- using python and flask for ocr annotation web tool☆25Jan 7, 2020Updated 6 years ago
- Comprehensive Python library for speech and voice.☆32Dec 8, 2022Updated 3 years ago
- ccf 2020 qa match competition top1☆265Jan 28, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆11Dec 13, 2023Updated 2 years ago
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆92Jul 19, 2021Updated 5 years ago
- ☆12Aug 11, 2019Updated 6 years ago
- Knowledge Distillation Toolbox for Semantic Segmentation☆17Nov 20, 2022Updated 3 years ago
- Author's implementation of "What Object Should I Use? - Task Driven Object Detection" (CVPR 2019)☆30Jul 25, 2024Updated last year
- Base on retinaface and centerface modefied. frame work depend on pytorch.☆31Jul 23, 2020Updated 6 years ago
- Source code for "Training Generative Adversarial Networks Via Turing Test".☆14May 29, 2020Updated 6 years ago
- ☆11Mar 30, 2021Updated 5 years ago
- basic algorithm☆11Nov 28, 2020Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Implementation of YOLO and IOU tracker in C++☆17Dec 20, 2021Updated 4 years ago
- 基于CenterNet训练的目标检测&人脸对齐&姿态估计模型☆290Mar 16, 2021Updated 5 years ago
- 开箱即用,支持windows, ubuntu和mac☆264Jul 24, 2023Updated 2 years ago
- 🤖 It is basic tools build for scraping & embedding text. The main technologies included OpenAI embeddings, Supabase and Next.js.☆16Apr 12, 2023Updated 3 years ago
- 使用Few-Shot方法来做文本分类任务,基于THUCNews数据☆10Jun 4, 2020Updated 6 years ago
- 基于RepVGG中的结构重参数化思想,对YOLOX模型进行了一些变形☆13Dec 8, 2021Updated 4 years ago
- 一款简单好用的 跨平台/多语言的 相似向量/相似词/相似句 高性能检索引擎。欢迎star & fork。Build together! Power another !☆549Dec 3, 2022Updated 3 years ago