aws-samples / torchserve-eks
How to deploy TorchServe on an Amazon EKS cluster for inference.
☆12Updated 4 years ago
Alternatives and similar repositories for torchserve-eks:
Users that are interested in torchserve-eks are comparing it to the libraries listed below
- SageMaker training implementation for computer vision to offload JPEG decoding and augmentations on GPUs using NVIDIA DALI — allowing yo…☆21Updated 3 years ago
- Serve scikit-learn, XGBoost, TensorFlow, and PyTorch models with AWS Lambda container images support.☆98Updated 8 months ago
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆137Updated 5 months ago
- Build a Docker container to build, train and deploy fast.ai based Deep Learning models with Amazon SageMaker☆13Updated 6 years ago
- ☆57Updated 2 years ago
- Amazon SageMaker Managed Spot Training Examples☆51Updated 8 months ago
- Deploy FastAI Trained PyTorch Model in TorchServe and Host in Amazon SageMaker Inference Endpoint☆74Updated 3 years ago
- MNIST classifier implementation with PyTorch Lightning on Amazon SageMaker☆24Updated 2 years ago
- Examples showing use of NGC containers and models withing Amazon SageMaker☆17Updated 2 years ago
- This is a sample solution for bringing your own ML models and inference code, and running them at scale using AWS serverless services.☆37Updated last year
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆202Updated last month
- Examples of AI Accelerators - GPU, AWS Inferential and Elastic Inference☆32Updated 4 years ago
- Build fast gradio demos of fastai learners☆35Updated 3 years ago
- Example templates for the delivery of custom ML solutions to production so you can get started quickly without having to make too many de…☆69Updated 9 months ago
- Distributed training with SageMaker's script mode using Horovod distributed deep learning framework☆32Updated 5 years ago
- ☆28Updated last year
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆55Updated 2 years ago
- A Starlette example for deployment in fastai2☆11Updated 4 years ago
- ☆16Updated 2 years ago
- SageMaker specific extensions to TensorFlow.☆54Updated 8 months ago
- Hosting code-server on Amazon SageMaker☆54Updated last year
- This repository is part of a blog post that guides users through creating a visual search application using Amazon SageMaker and Amazon E…☆11Updated last year
- From nothing to a deployed object detection model on SageMaker with Detectron2☆29Updated last year
- ☆20Updated 2 years ago
- Toolkit for allowing inference and serving with MXNet in SageMaker. Dockerfiles used for building SageMaker MXNet Containers are at https…☆28Updated last year
- This repository shows how to train an object detection algorithm with Detectron2 on Amazon SageMaker☆28Updated 3 years ago
- ☆40Updated 4 months ago
- Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment☆32Updated last year
- Amazon SageMaker MLOps deployment pipeline for A/B Testing of machine learning models.☆44Updated 3 years ago
- Starter template for image recognition server with FastAPI☆24Updated 4 years ago