This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆45May 29, 2025Updated last year
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Create an Amazon EKS cluster and run a distributed training example☆29Aug 19, 2024Updated 2 years ago
- ☆65Jul 15, 2026Updated 3 months ago
- AWS DevOps for Docker - a sample project to help you build Docker containers and run them on AWS. In addition to running locally, this p…☆40May 27, 2021Updated 5 years ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆26Aug 17, 2026Updated 2 months ago
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆19Sep 4, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆23Feb 18, 2025Updated last year
- Best practices, reference architectures, and examples for distributed AI training and inference on AWS.☆486Updated this week
- ☆10Oct 6, 2026Updated last week
- This Guidance demonstrates how to build an AI-assisted robot training and fleet management system using Amazon Bedrock foundation models …☆22Jul 23, 2026Updated 2 months ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆69Updated this week
- ☆13May 30, 2025Updated last year
- ☆18Nov 13, 2023Updated 2 years ago
- demo of keyless signing with the sigstore kubernetes policy controller☆11Sep 7, 2022Updated 4 years ago
- ☆74Jun 26, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Feb 26, 2021Updated 5 years ago
- ☆18Sep 20, 2026Updated 3 weeks ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆100Jul 28, 2026Updated 2 months ago
- Build and run container environment for LFRic☆11Jan 8, 2024Updated 2 years ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- This Guidance demonstrates how to deploy a generative artificial intelligence (AI) model provided by Amazon SageMaker JumpStart to create…☆18Oct 19, 2024Updated last year
- ☆12Nov 28, 2024Updated last year
- Migrating to Karpenter☆33Mar 25, 2024Updated 2 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆267Oct 6, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆13Apr 6, 2023Updated 3 years ago
- Quickly open links from from kubernetes resources using jsonpath templates.☆14Feb 26, 2026Updated 7 months ago
- ☆34Dec 20, 2024Updated last year
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- File Level Backup of apps running on Openshift / Kubernetes☆15Apr 25, 2019Updated 7 years ago
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated 2 years ago
- Template scripts to setup Docker Images compatible with running on MNP Batch☆15Apr 9, 2019Updated 7 years ago
- ☆35Apr 9, 2023Updated 3 years ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Oct 19, 2023Updated 2 years ago
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆30Aug 29, 2025Updated last year
- This Guidance demonstrates how enterprises can unlock the value of their data through the powerful generative AI capabilities of Amazon Q…☆20Jun 24, 2025Updated last year
- Azure Authentication Plugin for Vault☆17Oct 5, 2026Updated last week
- TwinGraph is a Python framework for distributed container orchestration using Kubernetes clusters, Docker Compose/Swarm or cloud resource…☆35Aug 9, 2024Updated 2 years ago
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆44Feb 18, 2026Updated 7 months ago
- ☆10Oct 8, 2026Updated last week