This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆45May 29, 2025Updated last year
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy and scale distributed python applications on Amazon EKS using Ray☆20Apr 13, 2026Updated 3 months ago
- Create an Amazon EKS cluster and run a distributed training example☆29Aug 19, 2024Updated last year
- AWS DevOps for Docker - a sample project to help you build Docker containers and run them on AWS. In addition to running locally, this p…☆41May 27, 2021Updated 5 years ago
- ☆64Jul 15, 2026Updated 2 weeks ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆26Jul 21, 2026Updated last week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆23Feb 18, 2025Updated last year
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆467Updated this week
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆66Jul 8, 2026Updated 3 weeks ago
- ☆13May 30, 2025Updated last year
- Terraform module to configure Datadog AWS integration☆37Oct 1, 2025Updated 9 months ago
- ☆18Nov 13, 2023Updated 2 years ago
- This Guidance helps software companies set up a automated system to detect error logs, generate bug fixes, and create pull requests. Help…☆29Oct 20, 2024Updated last year
- This repository contains sample IaC templates to demonstrate how to leverage Codebuild provisioning with AWS Proton.☆30Feb 12, 2026Updated 5 months ago
- ☆74Jun 26, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆40Jul 17, 2026Updated last week
- ☆11Feb 26, 2021Updated 5 years ago
- ☆15Updated this week
- Cluster doctor skills☆14May 23, 2026Updated 2 months ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆97Updated this week
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- ☆12Nov 28, 2024Updated last year
- Migrating to Karpenter☆34Mar 25, 2024Updated 2 years ago
- Tutorials and labs focused on educating users☆11Sep 6, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆13Apr 6, 2023Updated 3 years ago
- ☆34Dec 20, 2024Updated last year
- Basic Operator Building Tutorial☆11Jun 17, 2020Updated 6 years ago
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated 2 years ago
- Development repository for the yum-epel cookbook☆24Jul 9, 2026Updated 2 weeks ago
- Template scripts to setup Docker Images compatible with running on MNP Batch☆15Apr 9, 2019Updated 7 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆240Jul 15, 2026Updated 2 weeks ago
- OpenShift Pipelines workshop☆26Jan 4, 2023Updated 3 years ago
- ☆35Apr 9, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- ☆11Oct 19, 2023Updated 2 years ago
- ☆15Jun 6, 2025Updated last year
- MLOps on AWS using Amazon SageMaker Pipelines☆33Apr 13, 2023Updated 3 years ago
- Azure Authentication Plugin for Vault☆18Jul 15, 2026Updated 2 weeks ago
- TwinGraph is a Python framework for distributed container orchestration using Kubernetes clusters, Docker Compose/Swarm or cloud resource…☆35Aug 9, 2024Updated last year
- modification of pydarknet to support getting logits out of yolo darknet☆11Jul 8, 2018Updated 8 years ago