aws-samples / parallelize-ml-inferenceLinks
Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
☆33Updated 5 years ago
Alternatives and similar repositories for parallelize-ml-inference
Users that are interested in parallelize-ml-inference are comparing it to the libraries listed below
Sorting:
- HugsVision is a easy to use huggingface wrapper for state-of-the-art computer vision☆196Updated 2 years ago
- Plugin for deploying MLflow models to TorchServe☆110Updated 2 years ago
- Management Dashboard for Torchserve☆125Updated 2 years ago
- Deploy DL/ ML inference pipelines with minimal extra code.☆99Updated 9 months ago
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆141Updated 10 months ago
- Application for searching images from natural language queries☆46Updated 3 years ago
- This is a sample solution for bringing your own ML models and inference code, and running them at scale using AWS serverless services.☆38Updated last year
- Article about deploying machine learning models using grpc, pytorch and asyncio☆29Updated 2 years ago
- This repository shows how to train an object detection algorithm with Detectron2 on Amazon SageMaker☆29Updated 3 years ago
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 2 years ago
- ☆57Updated 3 years ago
- This repository contains notebooks that show the usage of TensorFlow Lite for quantizing deep neural networks.☆172Updated 2 years ago
- This project presents a simple framework to retrieve images similar to a query image.☆28Updated 4 years ago
- ☆32Updated 2 years ago
- From nothing to a deployed object detection model on SageMaker with Detectron2☆29Updated last year
- Machine Learning Pipeline for Semantic Segmentation with TensorFlow Extended (TFX) and various GCP products☆95Updated 2 years ago
- Open Source Annotation Tools for Computer Vision and NLP tasks☆53Updated 4 years ago
- FasterAI: Prune and Distill your models with FastAI and PyTorch☆249Updated 2 months ago
- Light Face Detection using PyTorch Lightning☆83Updated 2 years ago
- sachinsharma9780 / Build-ML-pipelines-for-Computer-Vision-NLP-and-Graph-Neural-Networks-using-Nvidia-Triton-ServerBuild ML pipelines for Computer Vision, NLP and Graph Neural Networks using Triton Server.☆41Updated 3 years ago
- ☆14Updated 3 years ago
- Aloception is a set of package for computer vision: aloscene, alodataset, alonet.☆93Updated 3 months ago
- ☆16Updated 2 years ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆205Updated 2 months ago
- Computer vision container that includes Jupyter notebooks with built-in code hinting, Anaconda, CUDA 11.8, TensorRT inference accelerator…☆157Updated last year
- Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.☆100Updated last year
- NVIDIA GPU Accelerated Application Samples in Google Cloud Platform☆20Updated 4 months ago
- Amazon SageMaker Managed Spot Training Examples☆51Updated last year
- Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference☆32Updated 4 years ago
- Comparing PyTorch, JIT and ONNX for inference with Transformers☆20Updated 4 years ago