This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It addresses the basic implementation requirements as well as ways you can pack thousands of unique PyTorch deep learning (DL) models into a scalable architecture and evaluate performance
☆45May 29, 2025Updated last year
Alternatives and similar repositories for guidance-for-machine-learning-inference-on-aws
Users that are interested in guidance-for-machine-learning-inference-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Deploy and scale distributed python applications on Amazon EKS using Ray☆20Apr 13, 2026Updated 4 months ago
- AWS DevOps for Docker - a sample project to help you build Docker containers and run them on AWS. In addition to running locally, this p…☆41May 27, 2021Updated 5 years ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆26Updated this week
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆470Updated this week
- This Guidance demonstrates how to build an AI-assisted robot training and fleet management system using Amazon Bedrock foundation models …☆20Jul 23, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆19Mar 12, 2026Updated 5 months ago
- ☆13May 30, 2025Updated last year
- demo of keyless signing with the sigstore kubernetes policy controller☆11Sep 7, 2022Updated 3 years ago
- This Guidance helps software companies set up a automated system to detect error logs, generate bug fixes, and create pull requests. Help…☆29Oct 20, 2024Updated last year
- This repository contains sample IaC templates to demonstrate how to leverage Codebuild provisioning with AWS Proton.☆30Feb 12, 2026Updated 6 months ago
- ☆74Jun 26, 2024Updated 2 years ago
- A CLI tool that helps manage training jobs on the SageMaker HyperPod clusters orchestrated by Amazon EKS☆41Updated this week
- ☆15Jul 23, 2026Updated 3 weeks ago
- Cluster doctor skills☆14May 23, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆98Jul 28, 2026Updated 3 weeks ago
- A really simple Spring Boot app, for demos. Displays information about cheese, for some reason.☆10Jun 12, 2026Updated 2 months ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- ☆12Nov 28, 2024Updated last year
- Migrating to Karpenter☆34Mar 25, 2024Updated 2 years ago
- The EKS workload accelerator is a collection of reference implementations for Amazon EKS designed to accelerate the time it takes to prov…☆38Oct 16, 2025Updated 10 months ago
- Quickly open links from from kubernetes resources using jsonpath templates.☆14Feb 26, 2026Updated 5 months ago
- ☆34Dec 20, 2024Updated last year
- Basic Operator Building Tutorial☆11Jun 17, 2020Updated 6 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- File Level Backup of apps running on Openshift / Kubernetes☆15Apr 25, 2019Updated 7 years ago
- GitHub Actions, Flux, and Amazon EKS ✨☆24Jul 8, 2022Updated 4 years ago
- Development repository for the yum-epel cookbook☆24Updated this week
- Template scripts to setup Docker Images compatible with running on MNP Batch☆15Apr 9, 2019Updated 7 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆248Jul 15, 2026Updated last month
- OpenShift Pipelines workshop☆26Jan 4, 2023Updated 3 years ago
- This repo contains the LookML for the model and dashboards used with the FHIR healthcare dataset to showcase how Looker can add value to …☆13Jan 5, 2023Updated 3 years ago
- Official AWS Startups repository that hosts plugins, skills, tools and resources to support startup builders on AWS☆16Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆35Apr 9, 2023Updated 3 years ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- AI画像・図面生成フローのオーケストレーション用リポジトリ☆15Feb 23, 2026Updated 5 months ago
- ☆10Jan 23, 2023Updated 3 years ago
- MLOps on AWS using Amazon SageMaker Pipelines☆33Apr 13, 2023Updated 3 years ago
- TwinGraph is a Python framework for distributed container orchestration using Kubernetes clusters, Docker Compose/Swarm or cloud resource…☆35Aug 9, 2024Updated 2 years ago
- Awesome List for AWS EKS☆67Sep 24, 2022Updated 3 years ago