aws-solutions-library-samples / guidance-for-machine-learning-inference-on-aws
This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆39Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for guidance-for-machine-learning-inference-on-aws
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆50Updated 3 weeks ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆41Updated 4 months ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆97Updated 3 years ago
- ☆31Updated this week
- ☆64Updated 4 months ago
- ☆87Updated last year
- Create an Amazon EKS cluster and run a distributed training example☆27Updated 3 months ago
- Distributed training using Kubeflow on Amazon EKS☆82Updated this week
- ☆27Updated 6 months ago
- CloudFormation to setup Kubeflow and Sagemaker Operators on EKS☆25Updated last year
- ☆25Updated last week
- A set of Docker images that include popular frameworks for machine learning, data science and visualization.☆99Updated this week
- AIOps modules is a collection of reusable Infrastructure as Code (IaC) modules for Machine Learning (ML), Foundation Models (FM), Large L…☆48Updated this week
- Some crazy experiments☆32Updated 3 weeks ago
- ☆32Updated 8 months ago
- Mistral on AWS examples for Bedrock & SageMaker☆50Updated this week
- ACK service controller for Amazon SageMaker☆41Updated last month
- ☆46Updated this week
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆197Updated this week
- AWS Generative AI Conversational RAG Reference (Galileo)☆73Updated last week
- ☆57Updated last year
- Secure data science with Amazon SageMaker Studio workshop. This workshop creates a reference architecture with security and controls to p…☆31Updated 4 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆129Updated last month
- Safe blue/green deployment of Amazon SageMaker endpoints using AWS CodePipeline, CodeBuild and CodeDeploy.☆104Updated 2 years ago
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆121Updated this week
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆64Updated last month
- ☆29Updated last month
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆56Updated 2 years ago
- ☆57Updated 4 months ago
- ☆29Updated 3 months ago