This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆46May 29, 2025Updated 11 months ago
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy and scale distributed python applications on Amazon EKS using Ray☆20Apr 13, 2026Updated 3 weeks ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆24Apr 20, 2026Updated 2 weeks ago
- Openfold inference architecture for Amazon EKS☆11Oct 1, 2024Updated last year
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆20Mar 12, 2026Updated last month
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆415Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆60Feb 5, 2026Updated 3 months ago
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆22Feb 18, 2025Updated last year
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆66Apr 20, 2026Updated 2 weeks ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆36Apr 30, 2026Updated last week
- Terraform module to configure Datadog AWS integration☆37Oct 1, 2025Updated 7 months ago
- ☆18Nov 13, 2023Updated 2 years ago
- Migrating to Karpenter☆34Mar 25, 2024Updated 2 years ago
- Cluster doctor skills☆15Feb 20, 2026Updated 2 months ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆93Oct 20, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- This repository contains sample IaC templates to demonstrate how to leverage Codebuild provisioning with AWS Proton.☆30Feb 12, 2026Updated 2 months ago
- This Guidance helps software companies set up a automated system to detect error logs, generate bug fixes, and create pull requests. Help…☆29Oct 20, 2024Updated last year
- Build and run container environment for LFRic☆10Jan 8, 2024Updated 2 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆219Apr 24, 2026Updated 2 weeks ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆52Jun 17, 2025Updated 10 months ago
- ☆34Dec 20, 2024Updated last year
- The EKS workload accelerator is a collection of reference implementations for Amazon EKS designed to accelerate the time it takes to prov…☆38Oct 16, 2025Updated 6 months ago
- Tutorials and labs focused on educating users☆11Sep 6, 2023Updated 2 years ago
- ☆12Nov 28, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Apr 6, 2023Updated 3 years ago
- ☆11Nov 26, 2024Updated last year
- "Docs 2.1" docs-as-code boilerplate☆17Mar 9, 2023Updated 3 years ago
- A really simple Spring Boot app, for demos. Displays information about cheese, for some reason.☆10Apr 30, 2026Updated last week
- Quickly open links from from kubernetes resources using jsonpath templates.☆14Feb 26, 2026Updated 2 months ago
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated 2 years ago
- File Level Backup of apps running on Openshift / Kubernetes☆15Apr 25, 2019Updated 7 years ago
- This GenAI solution enables users to extract insights from diverse data formats (video, audio, PDFs, text) through a unified interface. U…☆19Feb 12, 2026Updated 2 months ago
- ☆35Apr 9, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Basic Operator Building Tutorial☆11Jun 17, 2020Updated 5 years ago
- MLOps on AWS using Amazon SageMaker Pipelines☆33Apr 13, 2023Updated 3 years ago
- Template scripts to setup Docker Images compatible with running on MNP Batch☆15Apr 9, 2019Updated 7 years ago
- Development repository for the yum-epel cookbook☆24Updated this week
- ☆10Jan 23, 2023Updated 3 years ago
- TwinGraph is a Python framework for distributed container orchestration using Kubernetes clusters, Docker Compose/Swarm or cloud resource…☆34Aug 9, 2024Updated last year
- Local AWS - a lightweight AWS service emulator☆43Apr 26, 2026Updated last week