aws-samples / parallelize-ml-inference
Sample code for parallelizing across multiple CPU/GPUs on a single machine to speed up deep learning inference
☆33Updated 5 years ago
Alternatives and similar repositories for parallelize-ml-inference:
Users that are interested in parallelize-ml-inference are comparing it to the libraries listed below
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 2 years ago
- Article about deploying machine learning models using grpc, pytorch and asyncio☆28Updated 2 years ago
- Comparing PyTorch, JIT and ONNX for inference with Transformers☆18Updated 4 years ago
- NVIDIA GPU Accelerated Application Samples in Google Cloud Platform☆19Updated 2 weeks ago
- Plugin for deploying MLflow models to TorchServe☆108Updated 2 years ago
- Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.☆45Updated 3 years ago
- This is a sample solution for bringing your own ML models and inference code, and running them at scale using AWS serverless services.☆38Updated last year
- This repository is part of a blog post that guides users through creating a visual search application using Amazon SageMaker and Amazon E…☆11Updated last year
- ☆32Updated 2 years ago
- Minimal implementation of Denoised Smoothing (https://arxiv.org/abs/2003.01908) in TensorFlow.☆20Updated 3 years ago
- MNIST classifier implementation with PyTorch Lightning on Amazon SageMaker☆24Updated 2 years ago
- ☆16Updated 2 years ago
- Simple and easy stable diffusion inference with LightningModule on GPU, CPU and MPS (Possibly all devices supported by Lightning).☆17Updated last year
- The collection of bulding blocks building fine-tunable metric learning models☆32Updated 2 weeks ago
- ☆24Updated 2 years ago
- ☆57Updated 2 years ago
- This repository shows how to train an object detection algorithm with Detectron2 on Amazon SageMaker☆28Updated 3 years ago
- Management Dashboard for Torchserve☆120Updated 2 years ago
- PyTorch implementation of GANs (Generative Adversarial Networks). DCGAN, Pix2Pix, CycleGAN, SRGAN☆20Updated 3 years ago
- Metaflow tutorials for ODSC West 2021☆64Updated 3 years ago
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations☆14Updated 2 years ago
- TorchServe+Streamlit for easily serving your HuggingFace NER models☆33Updated 2 years ago
- Application for searching images from natural language queries☆46Updated 3 years ago
- Fast model deployment on AWS Lambda☆14Updated last year
- High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.☆86Updated 3 years ago
- Open Source Annotation Tools for Computer Vision and NLP tasks☆53Updated 3 years ago
- This project presents a simple framework to retrieve images similar to a query image.☆28Updated 4 years ago
- This is an SDK for Google Cloud Explainable AI service. Explainable AI SDK helps users build explanation metadata for their models and vi…☆25Updated 3 years ago
- sachinsharma9780 / Build-ML-pipelines-for-Computer-Vision-NLP-and-Graph-Neural-Networks-using-Nvidia-Triton-ServerBuild ML pipelines for Computer Vision, NLP and Graph Neural Networks using Triton Server.☆41Updated 2 years ago
- MultiOCR, an interface that connects multiple open-source OCR and various Cloud OCR.☆31Updated last year