aws-samples / parallelize-ml-inference
Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
☆33Updated 4 years ago
Alternatives and similar repositories for parallelize-ml-inference:
Users that are interested in parallelize-ml-inference are comparing it to the libraries listed below
- Article about deploying machine learning models using grpc, pytorch and asyncio☆28Updated 2 years ago
- ☆15Updated 2 years ago
- Comparing PyTorch, JIT and ONNX for inference with Transformers☆17Updated 4 years ago
- This repository shows how to train an object detection algorithm with Detectron2 on Amazon SageMaker☆28Updated 3 years ago
- Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.☆45Updated 3 years ago
- This project presents a simple framework to retrieve images similar to a query image.☆28Updated 3 years ago
- An Easy To Use PyTorch Computer Vision Library☆51Updated last year
- From nothing to a deployed object detection model on SageMaker with Detectron2☆29Updated last year
- Plugin for deploying MLflow models to TorchServe☆108Updated last year
- Metaflow tutorials for ODSC West 2021☆64Updated 3 years ago
- ☆57Updated 2 years ago
- Minimal implementation of Denoised Smoothing (https://arxiv.org/abs/2003.01908) in TensorFlow.☆20Updated 3 years ago
- ☆28Updated last year
- MNIST classifier implementation with PyTorch Lightning on Amazon SageMaker☆24Updated 2 years ago
- Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).☆17Updated last year
- SageMaker training implementation for computer vision to offload JPEG decoding and augmentations on GPUs using NVIDIA DALI — allowing yo…☆21Updated 3 years ago
- ☆32Updated 2 years ago
- This codebase is a starting point to get your Machine Learning project into Production.☆43Updated 4 years ago
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆67Updated last year
- Utilities for working with W&B and PyTorch Lightning in an educational context☆15Updated 3 years ago
- Management Dashboard for Torchserve☆121Updated 2 years ago
- ☆24Updated 2 years ago
- Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference☆32Updated 4 years ago
- NVIDIA GPU Accelerated Application Samples in Google Cloud Platform☆19Updated last month
- Collection of models and extensions for deployment in PyTorch☆24Updated 2 years ago
- ☆13Updated 3 years ago
- Open Source Annotation Tools for Computer Vision and NLP tasks☆53Updated 3 years ago
- Deploy FastAI Trained PyTorch Model in TorchServe and Host in Amazon SageMaker Inference Endpoint☆74Updated 3 years ago
- Dockerfile for deep learning on GPUs☆10Updated 6 years ago
- Adaptation of discriminative learning rates from the Fastai library for standard PyTorch.☆18Updated 5 years ago