This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆46May 29, 2025Updated 9 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below
Sorting:
- Create an Amazon EKS cluster and run a distributed training example☆29Aug 19, 2024Updated last year
- ☆57Feb 5, 2026Updated last month
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆24Jan 29, 2026Updated last month
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆21Feb 14, 2026Updated 3 weeks ago
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆400Updated this week
- Cluster doctor skills☆14Feb 20, 2026Updated 2 weeks ago
- Openfold inference architecture for Amazon EKS☆11Oct 1, 2024Updated last year
- ☆12May 30, 2025Updated 9 months ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆64Feb 28, 2026Updated last week
- ☆18Nov 13, 2023Updated 2 years ago
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆22Feb 18, 2025Updated last year
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆33Mar 2, 2026Updated last week
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆52Jun 17, 2025Updated 8 months ago
- This Guidance helps software companies set up a automated system to detect error logs, generate bug fixes, and create pull requests. Help…☆29Oct 20, 2024Updated last year
- This repository contains sample IaC templates to demonstrate how to leverage Codebuild provisioning with AWS Proton.☆30Feb 12, 2026Updated 3 weeks ago
- ☆34Dec 20, 2024Updated last year
- OpenShift Pipelines workshop☆26Jan 4, 2023Updated 3 years ago
- The EKS workload accelerator is a collection of reference implementations for Amazon EKS designed to accelerate the time it takes to prov…☆37Oct 16, 2025Updated 4 months ago
- MLOps on AWS using Amazon SageMaker Pipelines☆32Apr 13, 2023Updated 2 years ago
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆29Aug 29, 2025Updated 6 months ago
- Multiple ways to install cilium in eks☆34Mar 23, 2024Updated last year
- ☆73Jun 26, 2024Updated last year
- ☆39Nov 28, 2025Updated 3 months ago
- ☆32Aug 4, 2019Updated 6 years ago
- Terraform module to configure Datadog AWS integration☆37Oct 1, 2025Updated 5 months ago
- ☆11Oct 19, 2023Updated 2 years ago
- ☆14Feb 11, 2023Updated 3 years ago
- CDK construct for installing and configuring Karpenter on EKS clusters☆47Mar 1, 2026Updated last week
- Simple implementation of an AppSec Pipeline using the Gasp library☆13Sep 8, 2019Updated 6 years ago
- LLM의 다양한 튜닝 방법과 데이터 전처리 코드를 정리해놓았습니다.☆14Feb 23, 2026Updated 2 weeks ago
- ☆16Sep 6, 2022Updated 3 years ago
- today - command line day planner☆11Mar 11, 2025Updated 11 months ago
- ☆10Jun 18, 2024Updated last year
- ☆10Apr 2, 2024Updated last year
- General Use Timeseries Containers for Rust☆11Dec 31, 2020Updated 5 years ago
- "A practical guide to CUE: patterns for everyday use" - the demo!☆16Apr 9, 2022Updated 3 years ago
- Fine-tuning GPT-2 to generate research paper abstracts☆12Apr 28, 2021Updated 4 years ago
- 🎵 When AI tools vibe together on your PRs. Let CodeRabbit and Claude Code handle the repetitive feedback while you ship features. Built …☆12Nov 24, 2025Updated 3 months ago
- ☆10Jan 23, 2023Updated 3 years ago