aws-samples / sample-genai-on-eks-starter-kitLinks
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
☆28Updated last week
Alternatives and similar repositories for sample-genai-on-eks-starter-kit
Users that are interested in sample-genai-on-eks-starter-kit are comparing it to the libraries listed below
Sorting:
- Cloud-native, AI-powered, document processing pipelines on AWS.☆185Updated 8 months ago
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆89Updated last year
- ☆13Updated last month
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆51Updated 5 months ago
- Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference…☆19Updated last week
- aws-solutions-library-samples / guidance-for-natural-language-queries-of-relational-databases-on-awsDemonstration of Natural Language Query (NLQ) of an Amazon RDS for PostgreSQL database, using SageMaker JumpStart, Amazon Bedrock, LangCh…☆68Updated last year
- Build a custom user interface for more tailored, controlled, and consolidated interactions with Amazon Q business.☆53Updated last year
- ☆27Updated 6 months ago
- CDK template that deploys real-time voice interaction app using Amazon Nova Sonic with tool use☆65Updated 2 weeks ago
- This Guidance demonstrates how to create an intelligent manufacturing digital thread through a combination of knowledge graph and generat…☆23Updated 2 weeks ago
- Learn how to quickly build Agents with Amazon Bedrock☆102Updated last year
- CDK AWS Observability Accelerator☆150Updated this week
- AWS Well-Architected Framework Review (WAFR) Acceleration with Generative AI (GenAI) sample.☆82Updated last month
- Prompt Library for Amazon Q Developer☆74Updated last week
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆172Updated 4 months ago
- A demo ChatBot application developed using Amazon Bedrock service's KnowledgeBase, Agent and other AWS's serveless GenAI solution.☆123Updated last month
- ☆56Updated 6 months ago
- This repo provides sample generative AI stacks built atop the AWS Generative AI CDK Constructs.☆153Updated last week
- Mistral on AWS examples for Bedrock & SageMaker☆86Updated this week
- ☆13Updated last year
- Elevate Your DevOps Pipeline with Generative AI☆24Updated 9 months ago
- This Guidance demonstrates how to securely run Model Context Protocol (MCP) servers on the AWS Cloud using containerized architecture. It…☆130Updated 3 weeks ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 7 months ago
- The Automated Data Analytics on AWS solution provides an end-to-end data platform for ingesting, transforming, managing and querying data…☆90Updated last year
- Build Agentic AI solutions on AWS, using latest OSS Agentic Frameworks.☆200Updated this week
- End to end deployment and observability of polyglot microservices in Amazon EKS using AWS App Mesh, AWS Fargate, Amazon Cloudwatch Contai…☆74Updated 9 months ago
- ☆24Updated last month
- Content repository for Community.aws☆49Updated 11 months ago
- Amazon ECS Fargate workshop for developers, operators, and data engineers☆22Updated 5 years ago
- Try Artifacts and Code Interpreter Tool with Amazon Bedrock.☆111Updated 5 months ago