This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both serving and training scripts, RayOperator to manage Ray Clusters and Karpenter to manage Node Scaling.
☆53Jun 17, 2025Updated last year
Alternatives and similar repositories for gen-ai-on-eks
Users that are interested in gen-ai-on-eks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DoEKS is a tool to build, deploy and scale Data Platforms on Amazon EKS☆863Updated this week
- Source repo of the eks-upgrades workshop☆25Feb 11, 2025Updated last year
- ☆69Mar 3, 2026Updated 8 months ago
- ☆12Sep 5, 2024Updated 2 years ago
- ☆37Oct 13, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14May 18, 2026Updated 5 months ago
- AI on EKS - Tested AI/ML for Amazon Elastic Kubernetes Service☆228Updated this week
- ECS Blue/Green deployment using AWS CodePipeline and AWS CDK☆12Jan 22, 2021Updated 5 years ago
- Karpenter Blueprints is a list of common workload scenarios following best practices. You'll find here details of why configuring the Kar…☆349Sep 11, 2026Updated last month
- ☆18May 8, 2025Updated last year
- It shows a simple MCP agent based on LangGraph.☆12Sep 4, 2026Updated 2 months ago
- ☆32May 3, 2024Updated 2 years ago
- Source repo of Building SaaS applications on Amazon EKS using GitOps workshop☆107Apr 10, 2026Updated 6 months ago
- Training and inference on AWS Trainium and Inferentia chips.☆271Oct 30, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Document-Forgery-Detection☆13Oct 11, 2020Updated 6 years ago
- ☆72Nov 2, 2023Updated 3 years ago
- Open source project to help accelerate and ease observability setup on AWS environments☆341Apr 24, 2026Updated 6 months ago
- Ubuntu production level provisioning using Ansible, Packer and AWS☆17Aug 7, 2022Updated 4 years ago
- ☆11Sep 9, 2021Updated 5 years ago
- My basic kubernetes toolkit☆11Dec 24, 2021Updated 4 years ago
- ☆10Apr 11, 2024Updated 2 years ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆255Apr 11, 2025Updated last year
- ☆31Jan 4, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆10Jul 28, 2026Updated 3 months ago
- aws-security-architecture☆14Oct 17, 2023Updated 3 years ago
- ☆15Jul 17, 2024Updated 2 years ago
- For running containerized game servers on Spot instances reliably and safely☆40Oct 18, 2023Updated 3 years ago
- SmartKey's Kubernetes KMS plugin☆10Jul 22, 2023Updated 3 years ago
- A MCP Server that's built on top of AWS Cloud Financial Management (CFM) Technical Implementation Playbooks (TIPs) - our proven collectio…☆34Mar 20, 2026Updated 7 months ago
- ☆26Apr 10, 2025Updated last year
- Script to collect Pod related information from EKS Cluster☆18Feb 25, 2025Updated last year
- AWS Sentinel is a command-line security scanner for AWS resources. It helps identify common security issues in your AWS account. Now fea…☆31Jan 24, 2026Updated 9 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Jul 7, 2020Updated 6 years ago
- EC2 Flexibility Score assesses any configuration used to launch instances through an Auto Scaling Group (ASG) against the recommended EC2…☆27Apr 13, 2026Updated 6 months ago
- ☆11May 21, 2021Updated 5 years ago
- Terraform Module: Deploy Data/ML Addons Helm Charts on EKS 🚀☆46Aug 7, 2025Updated last year
- Play/Manage RabbitMQ☆10Jun 25, 2010Updated 16 years ago
- ☆14Aug 3, 2026Updated 3 months ago
- A CLI tool to simulate EC2 Spot Instances interruptions using AWS Fault Injection Simulator.☆12May 4, 2022Updated 4 years ago