aws-solutions-library-samples / guidance-for-machine-learning-inference-on-awsLinks
This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆47Updated 6 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below
Sorting:
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆51Updated 6 months ago
- ☆57Updated 2 weeks ago
- MLOps on Amazon EKS☆116Updated this week
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆63Updated 3 weeks ago
- Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other exampl…☆99Updated 4 years ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 8 months ago
- Create an Amazon EKS cluster and run a distributed training example☆29Updated last year
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆380Updated this week
- AI on EKS - Tested AI/ML for Amazon Elastic Kubernetes Service☆146Updated last week
- ☆89Updated 3 years ago
- CloudFormation to setup Kubeflow and Sagemaker Operators on EKS☆25Updated 2 years ago
- A set of Docker images that include popular frameworks for machine learning, data science and visualization.☆139Updated this week
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆25Updated last week
- ☆73Updated last year
- Some crazy experiments☆35Updated 3 months ago
- ☆131Updated last week
- ☆27Updated last year
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆151Updated this week
- ☆31Updated 3 months ago
- ☆44Updated 4 months ago
- ☆33Updated last year
- ACK service controller for Amazon SageMaker☆52Updated last week
- KubeFlow on AWS☆187Updated 2 months ago
- MLOps Pipeline Using SageMaker & CDK, where models are from SageMaker built-in algorithms.☆27Updated 8 months ago
- Secure and scalable MLOps platform on AWS using Terraform.☆43Updated 9 months ago
- ☆25Updated 3 weeks ago
- Mistral on AWS examples for Bedrock & SageMaker☆87Updated 2 weeks ago
- Example code for AWS Neuron SDK developers building inference and training applications☆152Updated this week
- AIOps modules is a collection of reusable Infrastructure as Code (IaC) modules for Machine Learning (ML), Foundation Models (FM), Large L…☆95Updated 2 weeks ago
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆89Updated last year