aws-solutions-library-samples / guidance-for-machine-learning-inference-on-awsLinks
This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆44Updated 2 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below
Sorting:
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆46Updated 2 months ago
- ☆52Updated 2 weeks ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆60Updated last week
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆334Updated this week
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆249Updated 4 months ago
- CloudFormation to setup Kubeflow and Sagemaker Operators on EKS☆25Updated 2 years ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆98Updated 4 years ago
- A set of Docker images that include popular frameworks for machine learning, data science and visualization.☆126Updated this week
- ☆73Updated last year
- ☆89Updated 2 years ago
- MLOps on Amazon EKS☆96Updated last week
- Some crazy experiments☆35Updated 6 months ago
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆148Updated 3 months ago
- ☆44Updated 3 weeks ago
- ☆30Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆147Updated this week
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆25Updated last week
- Mistral on AWS examples for Bedrock & SageMaker☆80Updated this week
- ☆114Updated this week
- ☆24Updated 2 months ago
- MLOps on AWS using Amazon SageMaker Pipelines☆32Updated 2 years ago
- Foundation Model Evaluations Library☆262Updated 2 weeks ago
- Hands-on workshop for distributed training and hosting on SageMaker☆146Updated 3 weeks ago
- ☆33Updated last year
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆81Updated 10 months ago
- Secure and scalable MLOps platform on AWS using Terraform.☆41Updated 5 months ago
- amazon-sagemaker-cdk-examples uses AWS CDK to simplify common architectures in machine leaning operations using Sagemaker and other AWS s…☆68Updated last year
- Create an Amazon EKS cluster and run a distributed training example☆28Updated last year
- ☆19Updated last year
- ACK service controller for Amazon SageMaker☆48Updated last week