roboflow / deploy-models-with-grpc-pytorch-asyncioLinks
Article about deploying machine learning models using grpc, pytorch and asyncio
☆28Updated 2 years ago
Alternatives and similar repositories for deploy-models-with-grpc-pytorch-asyncio
Users that are interested in deploy-models-with-grpc-pytorch-asyncio are comparing it to the libraries listed below
Sorting:
- Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).☆17Updated last year
- ☆13Updated 2 years ago
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆30Updated 2 years ago
- ☆32Updated 2 years ago
- This repository holds files and scripts for incorporating simple CI/CD practices for model training in ML.☆21Updated 3 years ago
- Create training data labels from a production model with Modzy, Dropbox, and Label Studio☆18Updated 2 years ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated 10 months ago
- Plugin for deploying MLflow models to TorchServe☆109Updated 2 years ago
- Using open-source LLM Llama2 by Meta on local CPU inference for document question-and-answer☆15Updated last year
- 🤝 Trade any tensors over the network☆30Updated last year
- A boilerplate to use multiprocessing for your gRPC server in your Python project☆25Updated 3 years ago
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆58Updated last month
- uses Lightly and Label Studio to performa a complete AL workflow from dataset scraping to usage☆36Updated last year
- ML/DL Math and Method notes☆61Updated last year
- Exporting youtube videos using whisper☆17Updated 2 years ago
- Deep Learning how-to's using Lance file format☆18Updated 8 months ago
- PyTorch at the Edge: Deploying Over 964 TIMM Models on Android with TorchScript and Flutter.☆44Updated 2 years ago
- ☆24Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 3 weeks ago
- Fast model deployment on AWS Lambda☆14Updated last year
- ☆17Updated 2 years ago
- Triton Server Component for lightning.ai☆14Updated 2 years ago
- ☆21Updated 2 years ago
- ☆16Updated 2 years ago
- ☆26Updated 2 years ago
- This project presents a simple framework to retrieve images similar to a query image.☆28Updated 4 years ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆82Updated last year
- Visual similarity search engine demo with use of PyTorch Metric Learning and Qdrant☆12Updated 2 years ago
- Utilities for working with videos☆13Updated 3 years ago
- Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference☆33Updated 5 years ago