aws-solutions-library-samples / guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksView on GitHub
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
☆19Mar 12, 2026Updated 5 months ago
Alternatives and similar repositories for guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Users that are interested in guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20Apr 20, 2026Updated 3 months ago
- ☆15Jul 23, 2026Updated 3 weeks ago
- ☆18Updated this week
- Official AWS Startups repository that hosts plugins, skills, tools and resources to support startup builders on AWS☆16Updated this week
- ☆19Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository shows you how to build real-time, voice-enabled AI agents with Pipecat and Amazon Bedrock☆38Mar 30, 2026Updated 4 months ago
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆19Jan 29, 2024Updated 2 years ago
- ☆17Apr 13, 2026Updated 4 months ago
- 🚀 Experimental AI demos showcasing Amazon Bedrock, open-source LLMs & creative possibilities. AI Agents, RAG systems, streaming agents &…☆37Updated this week
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆45May 29, 2025Updated last year
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆44Feb 18, 2026Updated 6 months ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆40May 21, 2024Updated 2 years ago
- This GenAI solution enables users to extract insights from diverse data formats (video, audio, PDFs, text) through a unified interface. U…☆22Feb 12, 2026Updated 6 months ago
- This Guidance demonstrates how to transform architecture diagrams into Infrastructure as Code (IaC) templates using AI, addressing the ch…☆48Aug 11, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- This project automates the text extraction, transcription and summarization of audio, video, and documents using Amazon Bedrock, Amazon T…☆18Sep 27, 2024Updated last year
- A really simple Spring Boot app, for demos. Displays information about cheese, for some reason.☆10Jun 12, 2026Updated 2 months ago
- This guidance demonstrates how to build a FinOps agent using Amazon Bedrock's multi-agent capability and Amazon Nova foundation models to…☆19Aug 20, 2025Updated 11 months ago
- Tutorials and labs focused on educating users☆11Sep 6, 2023Updated 2 years ago
- ☆13Apr 6, 2023Updated 3 years ago
- Basic Operator Building Tutorial☆11Jun 17, 2020Updated 6 years ago
- Chainlit application built using AWS CDK, secured with Amazon Cognito, that allows you to interact with Anthropic's Claude language model…☆36Feb 11, 2026Updated 6 months ago
- ☆29Dec 19, 2024Updated last year
- File Level Backup of apps running on Openshift / Kubernetes☆15Apr 25, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This Guidance shows how to build an Amazon Elastic Compute Cloud (Amazon EC2) Spot placement score tracker to monitor unused Amazon EC2 S…☆51Jul 28, 2026Updated 3 weeks ago
- This Guidance demonstrates how enterprises can unlock the value of their data through the powerful generative AI capabilities of Amazon Q…☆20Jun 24, 2025Updated last year
- ☆11Nov 30, 2019Updated 6 years ago
- GCO is a platform that spins up EKS Auto Mode clusters across AWS regions, wired together with Global Accelerator for low-latency routing…☆44Updated this week
- Jupyter notebook containing code from text preprocessing blog post☆10Nov 29, 2016Updated 9 years ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- Run Haystack Pipelines on Ray☆20Oct 16, 2024Updated last year
- ☆177Jun 23, 2026Updated last month
- ☆74Jul 27, 2026Updated 3 weeks ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆98Jul 28, 2026Updated 3 weeks ago
- An AWS Cloud Development Kit (CDK) sample showing how to configure the aws_lambda extension to send outgoing webhooks via Amazon EventBri…☆16Jul 24, 2026Updated 3 weeks ago
- Alternative password shadowing scheme☆11Aug 1, 2026Updated 2 weeks ago
- A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for…☆92Aug 9, 2026Updated last week
- Production-ready deployment patterns for running OpenAI Codex at enterprise scale on Amazon Bedrock — with corporate SSO, optional quota …☆25Jul 28, 2026Updated 3 weeks ago
- This project shows how to implement a simple SaaS metering system on AWS☆14Jul 28, 2026Updated 3 weeks ago
- dApp authentication with Amazon Cognito and Web3 proxy with Amazon API Gateway☆15Aug 5, 2024Updated 2 years ago