aws-samples / parallelize-ml-inference
Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
☆33Updated 4 years ago
Alternatives and similar repositories for parallelize-ml-inference:
Users that are interested in parallelize-ml-inference are comparing it to the libraries listed below
- ☆31Updated 2 years ago
- Comparing PyTorch, JIT and ONNX for inference with Transformers☆17Updated 3 years ago
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 2 years ago
- ☆15Updated 2 years ago
- NVIDIA GPU Accelerated Application Samples in Google Cloud Platform☆19Updated 2 weeks ago
- SageMaker training implementation for computer vision to offload JPEG decoding and augmentations on GPUs using NVIDIA DALI — allowing yo…☆21Updated 3 years ago
- ☆57Updated 2 years ago
- Plugin for deploying MLflow models to TorchServe☆108Updated last year
- An Easy To Use PyTorch Computer Vision Library☆51Updated last year
- Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference☆32Updated 4 years ago
- This is a sample solution for bringing your own ML models and inference code, and running them at scale using AWS serverless services.☆37Updated last year
- FastAPI for Triton☆17Updated 2 years ago
- This repository is part of a blog post that guides users through creating a visual search application using Amazon SageMaker and Amazon E…☆10Updated last year
- Open Source Annotation Tools for Computer Vision and NLP tasks☆53Updated 3 years ago
- This repository shows how to train an object detection algorithm with Detectron2 on Amazon SageMaker☆28Updated 3 years ago
- Light Face Detection using PyTorch Lightning☆84Updated last year
- [WIP] Behold, semantic-search, built over sentence-transformers to make it easy for search engineers to evaluate, optimise and deploy mod…☆15Updated last year
- Article about deploying machine learning models using grpc, pytorch and asyncio☆27Updated 2 years ago
- An open source implementation of CLIP.☆32Updated 2 years ago
- Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.☆97Updated 6 months ago
- Fast model deployment on AWS Lambda☆14Updated 11 months ago
- My personal data science blog☆25Updated 2 weeks ago
- An unstructured set of helper functions☆59Updated 3 years ago
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆32Updated 2 years ago
- This project presents a simple framework to retrieve images similar to a query image.☆27Updated 3 years ago
- Configuration classes enabling Hydra to configure and manage Pytorch Lightning projects.☆41Updated 3 years ago
- ☆28Updated last year
- High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.☆86Updated 2 years ago
- Aloception is a set of package for computer vision: aloscene, alodataset, alonet.☆92Updated last year
- Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.☆45Updated 3 years ago