Curt-Park / mnist-fastapi-aio-tritonLinks
Simple example of FastAPI + gRPC AsyncIO + Triton
☆65Updated 2 years ago
Alternatives and similar repositories for mnist-fastapi-aio-triton
Users that are interested in mnist-fastapi-aio-triton are comparing it to the libraries listed below
Sorting:
- Simple example of FastAPI + Celery + Triton for benchmarking☆64Updated 2 years ago
- ☆31Updated 2 years ago
- Archives for Triton Inference Server Practices☆15Updated 3 years ago
- Magface Triton Inferece Server Using Tensorrt☆16Updated 3 years ago
- Tiny configuration for Triton Inference Server☆45Updated 4 months ago
- ✨ Beautiful OCR Project Team Code by Team DKT☆12Updated 3 years ago
- Inference API server with echo and gRPC to triton server (golang)☆13Updated 2 years ago
- Using open-source LLM Llama2 by Meta on local CPU inference for document question-and-answer☆15Updated last year
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆33Updated 3 years ago
- The Triton backend for TensorRT.☆76Updated 3 weeks ago
- ☆29Updated 4 years ago
- Converting weights of Pytorch models to ONNX & TensorRT engines☆49Updated 2 years ago
- Torchserve + TensorRT + Detection☆19Updated 3 years ago
- The Triton backend for the ONNX Runtime.☆148Updated 3 weeks ago
- ☆32Updated 2 years ago
- showing various ways to serve Keras based stable diffusion☆110Updated 2 years ago
- This is a repo with a Triton Server deployment template☆24Updated 10 months ago
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆30Updated 2 years ago
- Triton backend for https://github.com/OpenNMT/CTranslate2☆35Updated last year
- ☆62Updated last year
- OpenVINO backend for Triton.☆31Updated 3 weeks ago
- An NVIDIA Triton Server workflow for OCR and the LayoutLMv3 Transformer Model☆30Updated 2 years ago
- This repo gives an introduction to how to make full working example to serve your model using asynchronous Celery tasks and FastAPI. 🔥 …☆32Updated last year
- This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.☆19Updated 9 months ago
- ☆96Updated 2 years ago
- Working example for serving a ML model using FastAPI and Celery☆75Updated 3 years ago
- Article about deploying machine learning models using grpc, pytorch and asyncio☆28Updated 2 years ago
- Making a PyTorch model easier than ever!☆79Updated 3 years ago
- Cross-lingual learning in scene text recognition (ICASSP2024)☆16Updated 8 months ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago