This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆45May 29, 2025Updated last year
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆65Jul 15, 2026Updated 3 months ago
- Deploy and scale distributed python applications on Amazon EKS using Ray☆21Apr 13, 2026Updated 6 months ago
- Create an Amazon EKS cluster and run a distributed training example☆29Aug 19, 2024Updated 2 years ago
- Openfold inference architecture for Amazon EKS☆11Oct 1, 2024Updated 2 years ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆26Aug 17, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Best practices, reference architectures, and examples for distributed AI training and inference on AWS.☆495Updated this week
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆20Sep 4, 2026Updated 2 months ago
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆23Feb 18, 2025Updated last year
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆30Aug 29, 2025Updated last year
- This Guidance demonstrates how to build an AI-assisted robot training and fleet management system using Amazon Bedrock foundation models …☆22Jul 23, 2026Updated 3 months ago
- ☆18Updated this week
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆70Oct 24, 2026Updated 2 weeks ago
- This Guidance helps software companies set up a automated system to detect error logs, generate bug fixes, and create pull requests. Help…☆29Oct 20, 2024Updated 2 years ago
- Terraform module to configure Datadog AWS integration☆37Oct 23, 2026Updated 2 weeks ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- demo of keyless signing with the sigstore kubernetes policy controller☆11Sep 7, 2022Updated 4 years ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆41Oct 28, 2026Updated last week
- ☆74Jun 26, 2024Updated 2 years ago
- ☆18Nov 13, 2023Updated 2 years ago
- ☆39Aug 14, 2024Updated 2 years ago
- Scripts to customize AWS ParallelCluster☆30Jun 11, 2026Updated 4 months ago
- This repository contains sample IaC templates to demonstrate how to leverage Codebuild provisioning with AWS Proton.☆30Feb 12, 2026Updated 8 months ago
- This Guidance demonstrates how to deploy a generative artificial intelligence (AI) model provided by Amazon SageMaker JumpStart to create…☆18Oct 19, 2024Updated 2 years ago
- Migrating to Karpenter☆33Mar 25, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A framework for building predictive modeling applications☆39Jul 27, 2022Updated 4 years ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- ☆17Oct 23, 2026Updated 2 weeks ago
- Tutorials and labs focused on educating users☆11Sep 6, 2023Updated 3 years ago
- This repository shows you how to build up an enterprise-ready DevSecOps Pipeline with GitHub☆11Aug 18, 2024Updated 2 years ago
- A simple UI for benchmarking and comparing open source models on different AWS instance types.☆13Sep 3, 2026Updated 2 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆255Apr 11, 2025Updated last year
- File Level Backup of apps running on Openshift / Kubernetes☆15Apr 25, 2019Updated 7 years ago
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Jul 28, 2026Updated 3 months ago
- Examples for running multi-node parallel (MNP) MPI jobs on AWS Batch.☆14Aug 25, 2023Updated 3 years ago
- OpenShift Pipelines workshop☆26Jan 4, 2023Updated 3 years ago
- ☆34Dec 20, 2024Updated last year
- A collection of examples built with AWS DataOps Development Kit (DDK)☆40Mar 23, 2026Updated 7 months ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- ☆11Jul 28, 2026Updated 3 months ago