aws-solutions-library-samples / guidance-for-machine-learning-inference-on-awsView external linksLinks
This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆46May 29, 2025Updated 8 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below
Sorting:
- AWS DevOps for Docker - a sample project to help you build Docker containers and run them on AWS. In addition to running locally, this p…☆39May 27, 2021Updated 4 years ago
- Deploy and scale distributed python applications on Amazon EKS using Ray☆19Feb 2, 2026Updated 2 weeks ago
- ☆57Feb 5, 2026Updated last week
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆24Jan 29, 2026Updated 2 weeks ago
- demo of keyless signing with the sigstore kubernetes policy controller☆11Sep 7, 2022Updated 3 years ago
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆20Updated this week
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆387Feb 7, 2026Updated last week
- Openfold inference architecture for Amazon EKS☆11Oct 1, 2024Updated last year
- ☆12May 30, 2025Updated 8 months ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆64Feb 7, 2026Updated last week
- ☆18Nov 13, 2023Updated 2 years ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆33Feb 10, 2026Updated last week
- This Guidance helps software companies set up a automated system to detect error logs, generate bug fixes, and create pull requests. Help…☆29Oct 20, 2024Updated last year
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆52Jun 17, 2025Updated 7 months ago
- Migrating to Karpenter☆34Mar 25, 2024Updated last year
- ☆34Dec 20, 2024Updated last year
- This repository contains sample IaC templates to demonstrate how to leverage Codebuild provisioning with AWS Proton.☆30Jan 30, 2026Updated 2 weeks ago
- End to end deployment and observability of polyglot microservices in Amazon EKS using AWS App Mesh, AWS Fargate, Amazon Cloudwatch Contai…☆74Feb 18, 2025Updated 11 months ago
- OpenShift Pipelines workshop☆26Jan 4, 2023Updated 3 years ago
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆29Aug 29, 2025Updated 5 months ago
- Awesome List for AWS EKS☆66Sep 24, 2022Updated 3 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆195Jul 8, 2025Updated 7 months ago
- Multiple ways to install cilium in eks☆33Mar 23, 2024Updated last year
- ☆73Jun 26, 2024Updated last year
- ☆39Nov 28, 2025Updated 2 months ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆90Oct 20, 2024Updated last year
- ☆35Apr 9, 2023Updated 2 years ago
- ☆11Oct 19, 2023Updated 2 years ago
- CDK construct for installing and configuring Karpenter on EKS clusters☆46Feb 1, 2026Updated 2 weeks ago
- ☆34Feb 8, 2022Updated 4 years ago
- 깃헙에 NLP 잔디심기 시즌 5☆10Aug 19, 2024Updated last year
- ☆10Jun 18, 2024Updated last year
- ☆10Apr 2, 2024Updated last year
- ☆11Nov 26, 2024Updated last year
- LLM의 다양한 튜닝 방법과 데이터 전처리 코드를 정리해놓았습니다.☆14Jan 13, 2026Updated last month
- ☆47Oct 29, 2024Updated last year
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated last year
- An experimental distributed map reduce system based on Google's MapReduce, written in Rust!☆10Aug 3, 2022Updated 3 years ago
- ☆16Sep 6, 2022Updated 3 years ago