aws-samples / sample-genai-on-eks-starter-kitLinks
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
☆18Updated this week
Alternatives and similar repositories for sample-genai-on-eks-starter-kit
Users that are interested in sample-genai-on-eks-starter-kit are comparing it to the libraries listed below
Sorting:
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆18Updated last week
- Using Mahjong to spin up the best solutions on AWS with few lines of yaml.☆12Updated 2 years ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆48Updated 4 months ago
- Collections of examples of using Terraform with AWS☆14Updated 8 months ago
- CDK AWS Observability Accelerator☆149Updated 2 months ago
- Build a custom user interface for more tailored, controlled, and consolidated interactions with Amazon Q business.☆53Updated 11 months ago
- ☆63Updated 2 years ago
- ☆12Updated 11 months ago
- AI on EKS - Tested AI/ML for Amazon Elastic Kubernetes Service☆130Updated last week
- Amazon ECS Fargate workshop for developers, operators, and data engineers☆22Updated 5 years ago
- This Guidance demonstrates how to securely run Model Context Protocol (MCP) servers on the AWS Cloud using containerized architecture. It…☆119Updated last month
- aws-solutions-library-samples / guidance-for-natural-language-queries-of-relational-databases-on-awsDemonstration of Natural Language Query (NLQ) of an Amazon RDS for PostgreSQL database, using SageMaker JumpStart, Amazon Bedrock, LangCh…☆67Updated last year
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆85Updated last year
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 6 months ago
- aws-solutions-library-samples / guidance-for-automated-provisioning-of-application-ready-amazon-eks-clustersThe EKS workload accelerator is a collection of reference implementations for Amazon EKS designed to accelerate the time it takes to prov…☆36Updated this week
- End to end deployment and observability of polyglot microservices in Amazon EKS using AWS App Mesh, AWS Fargate, Amazon Cloudwatch Contai…☆73Updated 8 months ago
- Demonstrate target tracking autoscaling for ECS services.☆10Updated 6 years ago
- ☆25Updated 5 months ago
- ☆55Updated last month
- eINS provides an additional layer of resilience for ECS external instances in deployment scenarios where connectivity to the on-region EC…☆10Updated 2 years ago
- A collection of recommended practices to accelerate the building of secure data science environments in regulated environments.☆49Updated 2 years ago
- Content repository for Community.aws☆50Updated 10 months ago
- Mistral on AWS examples for Bedrock & SageMaker☆85Updated this week
- ☆120Updated this week
- ☆18Updated this week
- Elevate Your DevOps Pipeline with Generative AI☆24Updated 8 months ago
- This pattern describes how to use AWS Control Tower Controls, AWS Cloud Development Kit (CDK) and infrastructure as code to implement and…☆41Updated last week
- ☆68Updated last year
- A tool that allows AWS customers to automate checks on their environment and services based on AWS best practices and provide recommendat…☆40Updated last year
- ☆18Updated last month