aws-samples / parallelize-ml-inference
Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
☆33Updated 4 years ago
Alternatives and similar repositories for parallelize-ml-inference:
Users that are interested in parallelize-ml-inference are comparing it to the libraries listed below
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 2 years ago
- Article about deploying machine learning models using grpc, pytorch and asyncio☆27Updated 2 years ago
- This is a sample solution for bringing your own ML models and inference code, and running them at scale using AWS serverless services.☆37Updated last year
- ☆28Updated last year
- ☆20Updated 3 years ago
- ☆15Updated 2 years ago
- This repository is part of a blog post that guides users through creating a visual search application using Amazon SageMaker and Amazon E…☆10Updated last year
- Comparing PyTorch, JIT and ONNX for inference with Transformers☆17Updated 3 years ago
- Plugin for deploying MLflow models to TorchServe☆107Updated last year
- ☆31Updated last year
- This repository shows how to train an object detection algorithm with Detectron2 on Amazon SageMaker☆28Updated 3 years ago
- ☆57Updated 2 years ago
- Material for the series of seminars on Large Language Models☆31Updated 8 months ago
- Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.☆45Updated 3 years ago
- Open Source Annotation Tools for Computer Vision and NLP tasks☆53Updated 3 years ago
- Code for a workshop hosted at the MLOps World Summit '22☆16Updated 2 years ago
- Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference☆32Updated 4 years ago
- Application for searching images from natural language queries☆46Updated 3 years ago
- The project completed for MLops Engineering Lab #1 by Team #1. See our wiki for more info☆16Updated 3 years ago
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations☆14Updated 2 years ago
- The collection of bulding blocks building fine-tunable metric learning models☆32Updated last week
- Management Dashboard for Torchserve☆120Updated last year
- Metaflow tutorials for ODSC West 2021☆64Updated 3 years ago
- From nothing to a deployed object detection model on SageMaker with Detectron2☆29Updated last year
- A high performance data access library for machine learning tasks☆74Updated last year
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated last year
- MultiOCR, an interface that connects multiple open-source OCR and various Cloud OCR.☆31Updated last year