aws-solutions-library-samples / guidance-for-machine-learning-inference-on-awsLinks
This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆47Updated 6 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below
Sorting:
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆51Updated 5 months ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆63Updated this week
- ☆57Updated this week
- CloudFormation to setup Kubeflow and Sagemaker Operators on EKS☆25Updated 2 years ago
- MLOps on Amazon EKS☆115Updated this week
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆99Updated 4 years ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 7 months ago
- ☆89Updated 3 years ago
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆377Updated last week
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆25Updated last week
- ☆127Updated last week
- ☆73Updated last year
- ☆33Updated last year
- Create an Amazon EKS cluster and run a distributed training example☆29Updated last year
- ☆44Updated 4 months ago
- Secure and scalable MLOps platform on AWS using Terraform.☆43Updated 8 months ago
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆149Updated 7 months ago
- A set of Docker images that include popular frameworks for machine learning, data science and visualization.☆138Updated this week
- ☆30Updated 2 months ago
- Some crazy experiments☆35Updated 3 months ago
- AI on EKS - Tested AI/ML for Amazon Elastic Kubernetes Service☆139Updated this week
- This Guidance shows how to build an Amazon Elastic Compute Cloud (Amazon EC2) Spot placement score tracker to monitor unused Amazon EC2 S…☆48Updated last year
- A Data Platform built for AWS, powered by Kubernetes.☆147Updated 2 years ago
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆89Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆151Updated this week
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆27Updated 8 months ago
- KubeFlow on AWS☆188Updated 2 months ago
- ☆46Updated this week
- Foundation Model Evaluations Library☆272Updated 4 months ago
- amazon-sagemaker-cdk-examples uses AWS CDK to simplify common architectures in machine leaning operations using Sagemaker and other AWS s…☆68Updated last year