This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both serving and training scripts, RayOperator to manage Ray Clusters and Karpenter to manage Node Scaling.
☆52Jun 17, 2025Updated 8 months ago
Alternatives and similar repositories for gen-ai-on-eks
Users that are interested in gen-ai-on-eks are comparing it to the libraries listed below
Sorting:
- A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for…☆41Updated this week
- ☆69Feb 11, 2026Updated 3 weeks ago
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆21Feb 14, 2026Updated 3 weeks ago
- DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS☆826Updated this week
- This is a Red Hat Enterprise Linux specific forked version of the official awslabs amazon-eks-ami repository.☆19Updated this week
- AWS CloudFormation and CDK Construct Library for IAM Roles for EKS Service Accounts☆18May 11, 2024Updated last year
- Terraform AWS module which provisions ACK addons on EKS☆52Oct 3, 2024Updated last year
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆46May 29, 2025Updated 9 months ago
- ☆29May 3, 2024Updated last year
- ☆25Feb 26, 2026Updated last week
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆255Apr 11, 2025Updated 10 months ago
- Open source project to help accelerate and ease observability setup on AWS environments☆319Oct 7, 2025Updated 4 months ago
- K8s Network Policy Migrator is a tool to migrate Calico or Cilium custom network policies to Kubernetes native network policy. The tool o…☆32Aug 29, 2023Updated 2 years ago
- ☆34Apr 10, 2025Updated 10 months ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆64Feb 28, 2026Updated last week
- Low-cost, secure, scalable, and feature-complete kubernetes in AWS via k3s☆29Jan 7, 2023Updated 3 years ago
- Script to collect Pod related information from EKS Cluster☆16Feb 25, 2025Updated last year
- ☆31Jan 4, 2024Updated 2 years ago
- AWS Sentinel is a command-line security scanner for AWS resources. It helps identify common security issues in your AWS account. Now fea…☆31Jan 24, 2026Updated last month
- ☆131Sep 25, 2024Updated last year
- Personalized nutritional app, serverless, tailored to your shopping and cooking needs, empowered by generative AI technology (Amazon Bedr…☆82Updated this week
- A collection of AWS Korea Startup SA team materials for hands-on labs.☆47Updated this week
- ☆138Updated this week
- ☆22Feb 11, 2026Updated 3 weeks ago
- Training and inference on AWS Trainium and Inferentia chips.☆261Updated this week
- ☆42Nov 17, 2025Updated 3 months ago
- This repo provides sample generative AI stacks built atop the AWS Generative AI CDK Constructs.☆167Updated this week
- Fully managed RAG solutions using Amazon Bedrock Knowledge Bases☆11Sep 26, 2024Updated last year
- ☆11May 21, 2021Updated 4 years ago
- Plugin which auto-subscribes a log delivery lambda function to lambda log groups created by serverless☆12Apr 17, 2023Updated 2 years ago
- ☆16Jun 10, 2024Updated last year
- This open-source project delivers a complete pipeline for converting multi-page documents (PDFs/images) into structured JSON using Vision…☆15Aug 4, 2025Updated 7 months ago
- ☆11Nov 30, 2019Updated 6 years ago
- Import Recommended Firewall Rules from vRNI to VMware Cloud on AWS or NSX-T☆10Feb 3, 2022Updated 4 years ago
- Build an AI Agent for your network☆27Apr 25, 2025Updated 10 months ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 2 years ago
- ☆12Jun 17, 2024Updated last year
- This repository contains all the example code to help you build a content aggregator like serverless land. It is split into 2 components:…☆40Sep 23, 2025Updated 5 months ago
- ☆11Jan 8, 2024Updated 2 years ago