This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆45May 29, 2025Updated last year
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy and scale distributed python applications on Amazon EKS using Ray☆20Apr 13, 2026Updated 2 months ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆25Updated this week
- AWS DevOps for Docker - a sample project to help you build Docker containers and run them on AWS. In addition to running locally, this p…☆41May 27, 2021Updated 5 years ago
- Openfold inference architecture for Amazon EKS☆11Oct 1, 2024Updated last year
- Create an Amazon EKS cluster and run a distributed training example☆29Aug 19, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆19Mar 12, 2026Updated 3 months ago
- ☆63Feb 5, 2026Updated 5 months ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆39Jun 22, 2026Updated 2 weeks ago
- ☆18Nov 13, 2023Updated 2 years ago
- Migrating to Karpenter☆34Mar 25, 2024Updated 2 years ago
- ☆74Jun 26, 2024Updated 2 years ago
- Cluster doctor skills☆14May 23, 2026Updated last month
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆96Oct 20, 2024Updated last year
- This repository contains sample IaC templates to demonstrate how to leverage Codebuild provisioning with AWS Proton.☆30Feb 12, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Feb 26, 2021Updated 5 years ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- ☆34Dec 20, 2024Updated last year
- Tutorials and labs focused on educating users☆11Sep 6, 2023Updated 2 years ago
- ☆12Nov 28, 2024Updated last year
- ☆11Jun 8, 2026Updated last month
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- A really simple Spring Boot app, for demos. Displays information about cheese, for some reason.☆10Jun 12, 2026Updated 3 weeks ago
- Quickly open links from from kubernetes resources using jsonpath templates.☆14Feb 26, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated 2 years ago
- ☆11Oct 19, 2023Updated 2 years ago
- This GenAI solution enables users to extract insights from diverse data formats (video, audio, PDFs, text) through a unified interface. U…☆21Feb 12, 2026Updated 4 months ago
- OpenShift Pipelines workshop☆26Jan 4, 2023Updated 3 years ago
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆30Aug 29, 2025Updated 10 months ago
- ☆35Apr 9, 2023Updated 3 years ago
- Basic Operator Building Tutorial☆11Jun 17, 2020Updated 6 years ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 5 years ago
- MLOps on AWS using Amazon SageMaker Pipelines☆33Apr 13, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆10Nov 2, 2023Updated 2 years ago
- Terraform module to provision AWS Guard Duty☆31Jul 2, 2026Updated last week
- Repository with the code for running deep learning inference benchmarks on different AWS instances and service types.☆14Nov 19, 2024Updated last year
- Galaxy on AWS Guidance provides all the infrastructure components required to run Galaxy in the cloud and are preconfigured with industry…☆19Feb 10, 2025Updated last year
- ☆15Jun 6, 2025Updated last year
- Template scripts to setup Docker Images compatible with running on MNP Batch☆15Apr 9, 2019Updated 7 years ago
- Development repository for the yum-epel cookbook☆24Jul 2, 2026Updated last week