aws-samples / parallelize-ml-inferenceLinks
Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
☆33Updated 5 years ago
Alternatives and similar repositories for parallelize-ml-inference
Users that are interested in parallelize-ml-inference are comparing it to the libraries listed below
Sorting:
- Article about deploying machine learning models using grpc, pytorch and asyncio☆30Updated 3 years ago
- Plugin for deploying MLflow models to TorchServe☆110Updated 2 years ago
- This repository shows how to train an object detection algorithm with Detectron2 on Amazon SageMaker☆29Updated 4 years ago
- This project presents a simple framework to retrieve images similar to a query image.☆29Updated 4 years ago
- HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision☆198Updated 2 years ago
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆142Updated last year
- ☆32Updated 3 years ago
- Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).☆17Updated 2 years ago
- Application for searching images from natural language queries☆46Updated 4 years ago
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 3 years ago
- ☆57Updated 3 years ago
- Management Dashboard for Torchserve☆125Updated 3 years ago
- Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference☆32Updated 5 years ago
- Aloception is a set of package for computer vision: aloscene, alodataset, alonet.☆93Updated 8 months ago
- Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products☆97Updated 2 years ago
- ☆29Updated 2 years ago
- SageMaker training implementation for computer vision to offload JPEG decoding and augmentations on GPUs using NVIDIA DALI — allowing yo…☆21Updated 4 years ago
- Amazon SageMaker Managed Spot Training Examples☆51Updated last year
- Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.☆45Updated 4 years ago
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆30Updated 3 years ago
- Open Source Annotation Tools for Computer Vision and NLP tasks☆57Updated 4 years ago
- Deploy DL/ ML inference pipelines with minimal extra code.☆102Updated last year
- Metaflow tutorials for ODSC West 2021☆65Updated 4 years ago
- https://blog.tensorflow.org/2021/12/continuous-adaptation-for-machine.html☆30Updated 4 years ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆205Updated 5 months ago
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆33Updated 3 years ago
- ☆17Updated 3 years ago
- This is a sample solution for bringing your own ML models and inference code, and running them at scale using AWS serverless services.☆38Updated 2 years ago
- ☆35Updated 3 years ago
- This repository is part of a blog post that guides users through creating a visual search application using Amazon SageMaker and Amazon E…☆11Updated 2 years ago