aws-solutions-library-samples / guidance-for-machine-learning-inference-on-awsLinks
This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆44Updated 2 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below
Sorting:
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆45Updated last month
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆60Updated last month
- MLOps on Amazon EKS☆93Updated 3 weeks ago
- ☆50Updated last week
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆247Updated 3 months ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆97Updated 4 years ago
- Some crazy experiments☆34Updated 6 months ago
- ☆88Updated 2 years ago
- CloudFormation to setup Kubeflow and Sagemaker Operators on EKS☆25Updated 2 years ago
- ☆44Updated last year
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆331Updated this week
- Create an Amazon EKS cluster and run a distributed training example☆28Updated 11 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆144Updated last week
- A set of Docker images that include popular frameworks for machine learning, data science and visualization.☆124Updated this week
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆24Updated 2 months ago
- ☆33Updated last year
- AI on EKS - Tested AI/ML for Amazon Elastic Kubernetes Service☆106Updated this week
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆148Updated 3 months ago
- ☆72Updated last year
- ☆24Updated 2 months ago
- ☆111Updated 2 weeks ago
- Foundation Model Evaluations Library☆259Updated 2 weeks ago
- Example code for AWS Neuron SDK developers building inference and training applications☆148Updated this week
- Amazon SageMaker Local Mode Examples☆259Updated 3 months ago
- ACK service controller for Amazon SageMaker☆48Updated 2 weeks ago
- ☆30Updated last year
- MLOps on AWS using Amazon SageMaker Pipelines☆32Updated 2 years ago
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆79Updated 9 months ago
- amazon-sagemaker-cdk-examples uses AWS CDK to simplify common architectures in machine leaning operations using Sagemaker and other AWS s…☆68Updated last year
- ☆28Updated last year