aws-samples / parallelize-ml-inferenceLinks
Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
☆33Updated 5 years ago
Alternatives and similar repositories for parallelize-ml-inference
Users that are interested in parallelize-ml-inference are comparing it to the libraries listed below
Sorting:
- ☆16Updated 2 years ago
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 2 years ago
- SageMaker training implementation for computer vision to offload JPEG decoding and augmentations on GPUs using NVIDIA DALI — allowing yo…☆21Updated 3 years ago
- Article about deploying machine learning models using grpc, pytorch and asyncio☆28Updated 2 years ago
- Plugin for deploying MLflow models to TorchServe☆109Updated 2 years ago
- Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.☆45Updated 4 years ago
- ☆57Updated 3 years ago
- This project presents a simple framework to retrieve images similar to a query image.☆28Updated 4 years ago
- Build fast gradio demos of fastai learners☆35Updated 3 years ago
- https://blog.tensorflow.org/2021/12/continuous-adaptation-for-machine.html☆29Updated 3 years ago
- Open Source Annotation Tools for Computer Vision and NLP tasks☆53Updated 3 years ago
- Application for searching images from natural language queries☆46Updated 3 years ago
- This codebase is a starting point to get your Machine Learning project into Production.☆43Updated 4 years ago
- Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference☆32Updated 4 years ago
- uses Lightly and Label Studio to performa a complete AL workflow from dataset scraping to usage☆36Updated last year
- Contains Colab Notebooks show cool use-cases of different GCP ML APIs.☆10Updated 4 years ago
- Fast model deployment on AWS Lambda☆14Updated last year
- Management Dashboard for Torchserve☆122Updated 2 years ago
- Dockerfile for deep learning on GPUs☆10Updated 6 years ago
- This repository shows various ways of deploying a vision model (TensorFlow) from 🤗 Transformers.☆30Updated 2 years ago
- A Starlette example for deployment in fastai2☆11Updated 4 years ago
- Adaptation of discriminative learning rates from the Fastai library for standard PyTorch.☆18Updated 5 years ago
- A library that lets you easily increase efficiency of your deep learning models with no loss of accuracy.☆22Updated last month
- Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).☆17Updated last year
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated 2 years ago
- MNIST classifier implementation with PyTorch Lightning on Amazon SageMaker☆24Updated 2 years ago
- An Easy To Use PyTorch Computer Vision Library☆52Updated last year
- How to deploy TorchServe on an Amazon EKS cluster for inference.☆12Updated 4 years ago
- ☆32Updated 2 years ago
- ☆24Updated 2 years ago