This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆46May 29, 2025Updated 10 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy and scale distributed python applications on Amazon EKS using Ray☆19Mar 19, 2026Updated last week
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆24Jan 29, 2026Updated 2 months ago
- AWS DevOps for Docker - a sample project to help you build Docker containers and run them on AWS. In addition to running locally, this p…☆41May 27, 2021Updated 4 years ago
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆21Mar 12, 2026Updated 2 weeks ago
- Openfold inference architecture for Amazon EKS☆11Oct 1, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Create an Amazon EKS cluster and run a distributed training example☆29Aug 19, 2024Updated last year
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆404Updated this week
- ☆58Feb 5, 2026Updated last month
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆22Feb 18, 2025Updated last year
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆66Mar 18, 2026Updated last week
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆33Updated this week
- Terraform module to configure Datadog AWS integration☆37Oct 1, 2025Updated 5 months ago
- demo of keyless signing with the sigstore kubernetes policy controller☆11Sep 7, 2022Updated 3 years ago
- ☆18Nov 13, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Migrating to Karpenter☆34Mar 25, 2024Updated 2 years ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆90Oct 20, 2024Updated last year
- ☆73Jun 26, 2024Updated last year
- Cluster doctor skills☆14Feb 20, 2026Updated last month
- Build and run container environment for LFRic☆10Jan 8, 2024Updated 2 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆209Updated this week
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆52Jun 17, 2025Updated 9 months ago
- ☆34Dec 20, 2024Updated last year
- The EKS workload accelerator is a collection of reference implementations for Amazon EKS designed to accelerate the time it takes to prov…☆38Oct 16, 2025Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆13Apr 6, 2023Updated 2 years ago
- ☆12Nov 28, 2024Updated last year
- GitHub Actions, Flux, and Amazon EKS ✨☆24Jul 8, 2022Updated 3 years ago
- ☆11Nov 26, 2024Updated last year
- "Docs 2.1" docs-as-code boilerplate☆17Mar 9, 2023Updated 3 years ago
- Quickly open links from from kubernetes resources using jsonpath templates.☆14Feb 26, 2026Updated last month
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated 2 years ago
- ☆11Oct 19, 2023Updated 2 years ago
- OpenShift Pipelines workshop☆26Jan 4, 2023Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆30Aug 29, 2025Updated 7 months ago
- MLOps on AWS using Amazon SageMaker Pipelines☆32Apr 13, 2023Updated 2 years ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 5 years ago
- A Python CLI application that demonstrates how you can access AWS services, such as Amazon S3 and Amazon Athena, using trusted identity p…☆12Mar 11, 2025Updated last year
- ☆10Nov 2, 2023Updated 2 years ago
- Galaxy on AWS Guidance provides all the infrastructure components required to run Galaxy in the cloud and are preconfigured with industry…☆18Feb 10, 2025Updated last year
- ☆15Jun 6, 2025Updated 9 months ago