aws-solutions-library-samples / guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksView on GitHub
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
☆19Sep 4, 2026Updated this week
Alternatives and similar repositories for guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Users that are interested in guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆22Apr 20, 2026Updated 4 months ago
- ☆15Aug 28, 2026Updated last week
- Official AWS Startups repository that hosts plugins, skills, tools and resources to support startup builders on AWS☆17Updated this week
- This Guidance demonstrates how to build an AI-assisted robot training and fleet management system using Amazon Bedrock foundation models …☆22Jul 23, 2026Updated last month
- Inspired by Tony Stark's robotic assistant Dum-E, the mission of this project is to create an intelligent, voice & vision enabled AI agen…☆26Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆19Jan 29, 2024Updated 2 years ago
- 🚀 Experimental AI demos showcasing Amazon Bedrock, open-source LLMs & creative possibilities. AI Agents, RAG systems, streaming agents &…☆39Aug 17, 2026Updated 3 weeks ago
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆45May 29, 2025Updated last year
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆44Feb 18, 2026Updated 6 months ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆40May 21, 2024Updated 2 years ago
- This GenAI solution enables users to extract insights from diverse data formats (video, audio, PDFs, text) through a unified interface. U…☆22Feb 12, 2026Updated 6 months ago
- This Guidance demonstrates how to transform architecture diagrams into Infrastructure as Code (IaC) templates using AI, addressing the ch…☆48Aug 20, 2026Updated 2 weeks ago
- This project automates the text extraction, transcription and summarization of audio, video, and documents using Amazon Bedrock, Amazon T…☆18Sep 27, 2024Updated last year
- A Streamlit app for exploring available AWS EC2 Capacity Blocks and SageMaker Training Plans across regions and instance types.☆28Aug 3, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Tutorials and labs focused on educating users☆11Sep 6, 2023Updated 3 years ago
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- ☆14May 19, 2023Updated 3 years ago
- This Guidance shows how to build an Amazon Elastic Compute Cloud (Amazon EC2) Spot placement score tracker to monitor unused Amazon EC2 S…☆52Jul 28, 2026Updated last month
- This Guidance demonstrates how enterprises can unlock the value of their data through the powerful generative AI capabilities of Amazon Q…☆20Jun 24, 2025Updated last year
- GCO is a platform that spins up EKS Auto Mode clusters across AWS regions, wired together with Global Accelerator for low-latency routing…☆44Updated this week
- Jupyter notebook containing code from text preprocessing blog post☆10Nov 29, 2016Updated 9 years ago
- Repo public contenant le code source des packages d'Extinction-MiniJeux pour Windows et Mac☆12Feb 1, 2026Updated 7 months ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Run Haystack Pipelines on Ray☆20Oct 16, 2024Updated last year
- ☆180Jun 23, 2026Updated 2 months ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆98Jul 28, 2026Updated last month
- An AWS Cloud Development Kit (CDK) sample showing how to configure the aws_lambda extension to send outgoing webhooks via Amazon EventBri…☆16Jul 24, 2026Updated last month
- A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for…☆94Updated this week
- Production-ready deployment patterns for running OpenAI Codex at enterprise scale on Amazon Bedrock — with corporate SSO, optional quota …☆27Aug 18, 2026Updated 2 weeks ago
- This Guidance provides a sample foundation for building real-time voice AI agents on AWS. It demonstrates how to build a voice assistant …☆47Updated this week
- This project shows how to implement a simple SaaS metering system on AWS☆14Jul 28, 2026Updated last month
- dApp authentication with Amazon Cognito and Web3 proxy with Amazon API Gateway☆15Aug 5, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆18May 8, 2025Updated last year
- This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.☆15Jan 20, 2026Updated 7 months ago
- ☆41Apr 27, 2025Updated last year
- ☆41Updated this week
- ☆10Mar 30, 2020Updated 6 years ago
- The Amazon S3 Glacier Re:Freezer is a serverless solution that automatically copies entire Amazon S3 Glacier vault archives to a defined …☆20Jan 29, 2024Updated 2 years ago
- This GitHub repository hosts the artifacts for the AWS Containers blog on developing Twelve Factor Apps on ECS using Fargate.☆23May 1, 2023Updated 3 years ago