This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆45May 29, 2025Updated last year
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy and scale distributed python applications on Amazon EKS using Ray☆20Apr 13, 2026Updated 4 months ago
- Create an Amazon EKS cluster and run a distributed training example☆29Aug 19, 2024Updated 2 years ago
- AWS DevOps for Docker - a sample project to help you build Docker containers and run them on AWS. In addition to running locally, this p…☆41May 27, 2021Updated 5 years ago
- Openfold inference architecture for Amazon EKS☆11Oct 1, 2024Updated last year
- A do-framework project to simplify deployment of Kubeflow on Amazon EKS☆23Feb 18, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Best practices, reference architectures, and examples for distributed AI training and inference on AWS.☆473Updated this week
- ☆10Aug 4, 2026Updated last month
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆19Updated this week
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆67Aug 27, 2026Updated last week
- ☆13May 30, 2025Updated last year
- Terraform module to configure Datadog AWS integration☆37Oct 1, 2025Updated 11 months ago
- demo of keyless signing with the sigstore kubernetes policy controller☆11Sep 7, 2022Updated 4 years ago
- ☆18Nov 13, 2023Updated 2 years ago
- ☆74Jun 26, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆41Updated this week
- Build and run container environment for LFRic☆11Jan 8, 2024Updated 2 years ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆98Jul 28, 2026Updated last month
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- ☆12Nov 28, 2024Updated last year
- ☆13Apr 6, 2023Updated 3 years ago
- Quickly open links from from kubernetes resources using jsonpath templates.☆14Feb 26, 2026Updated 6 months ago
- Basic Operator Building Tutorial☆11Jun 17, 2020Updated 6 years ago
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lambda layer to enable using famous NLTK python package with AWS lambda☆10Mar 21, 2024Updated 2 years ago
- GitHub Actions, Flux, and Amazon EKS ✨☆24Jul 8, 2022Updated 4 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆252Aug 19, 2026Updated 2 weeks ago
- ☆11Jul 28, 2026Updated last month
- This repo contains the LookML for the model and dashboards used with the FHIR healthcare dataset to showcase how Looker can add value to …☆13Jan 5, 2023Updated 3 years ago
- CDK construct to deploy an Ethereum node running on Amazon Managed Blockchain☆15Jul 1, 2026Updated 2 months ago
- Official AWS Startups repository that hosts plugins, skills, tools and resources to support startup builders on AWS☆17Updated this week
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- ☆11Oct 19, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A guidance that provides declarative data processing capability, and workflow orchestration automation to help your business users (such …☆30Aug 29, 2025Updated last year
- AI画像・図面生成フローのオーケストレーション用 リポジトリ☆15Feb 23, 2026Updated 6 months ago
- Azure Authentication Plugin for Vault☆17Updated this week
- MLOps on AWS using Amazon SageMaker Pipelines☆33Apr 13, 2023Updated 3 years ago
- Awesome List for AWS EKS☆67Sep 24, 2022Updated 3 years ago
- ☆10Updated this week
- Repository with the code for running deep learning inference benchmarks on different AWS instances and service types.☆14Nov 19, 2024Updated last year