Curt-Park / mnist-fastapi-aio-triton
Simple example of FastAPI + gRPC AsyncIO + Triton
☆56Updated 2 years ago
Related projects: ⓘ
- Simple example of FastAPI + Celery + Triton for benchmarking☆60Updated 2 years ago
- Archives for Triton Inference Server Practices☆15Updated 2 years ago
- ✨ Beautiful OCR Project Team Code by Team DKT☆12Updated 3 years ago
- Tiny configuration for Triton Inference Server☆42Updated 2 months ago
- This project shows how to serve an TF based image classification model as a web service with TFServing, Docker, and Kubernetes(GKE).☆120Updated 2 years ago
- ☆45Updated 3 years ago
- ☆29Updated 2 years ago
- ☆97Updated 2 years ago
- Deploy stable diffusion model with onnx/tenorrt + tritonserver☆119Updated last year
- Making a PyTorch model easier than ever!☆78Updated 2 years ago
- Plugin for deploying MLflow models to TorchServe☆106Updated last year
- Magface Triton Inferece Server Using Tensorrt☆15Updated 2 years ago
- Converting weights of Pytorch models to ONNX & TensorRT engines☆46Updated last year
- showing various ways to serve Keras based stable diffusion☆109Updated last year
- Inference API server with echo and gRPC to triton server (golang)☆12Updated last year
- Serving Example of CodeGen-350M-Mono-GPTJ on Triton Inference Server with Docker and Kubernetes☆20Updated last year
- The Triton backend for TensorRT.☆59Updated last week
- Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products☆93Updated last year
- Simple gRPC with images in python.☆16Updated 4 years ago
- ☆29Updated 3 years ago
- This repository serves as an example of deploying the YOLO models on Triton Server for performance and testing purposes☆38Updated 3 months ago
- Python Project Template☆66Updated 2 years ago
- The Triton backend for the ONNX Runtime.☆122Updated this week
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆31Updated 3 years ago
- ☆53Updated 7 months ago
- This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.☆193Updated 2 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆122Updated last week
- Stream and process multiple videos in near real time using Kafka. The video frames are processed and a machine learning model does infere…☆55Updated 3 years ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆56Updated last year