aws-solutions-library-samples / guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksView on GitHub
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
☆19Mar 12, 2026Updated 4 months ago
Alternatives and similar repositories for guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Users that are interested in guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆20Apr 20, 2026Updated 3 months ago
- ☆15Jul 23, 2026Updated last week
- ☆16Jul 16, 2026Updated last week
- Official AWS Startups repository that hosts plugins, skills, tools and resources to support startup builders on AWS☆15Updated this week
- ☆17Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository shows you how to build real-time, voice-enabled AI agents with Pipecat and Amazon Bedrock☆38Mar 30, 2026Updated 3 months ago
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆19Jan 29, 2024Updated 2 years ago
- ☆17Apr 13, 2026Updated 3 months ago
- 🚀 Experimental AI demos showcasing Amazon Bedrock, open-source LLMs & creative possibilities. AI Agents, RAG systems, streaming agents &…☆34Jul 22, 2026Updated last week
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆45May 29, 2025Updated last year
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆44Feb 18, 2026Updated 5 months ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆41May 21, 2024Updated 2 years ago
- This GenAI solution enables users to extract insights from diverse data formats (video, audio, PDFs, text) through a unified interface. U…☆22Feb 12, 2026Updated 5 months ago
- This Guidance demonstrates how to transform architecture diagrams into Infrastructure as Code (IaC) templates using AI, addressing the ch…☆46Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- This project automates the text extraction, transcription and summarization of audio, video, and documents using Amazon Bedrock, Amazon T…☆18Sep 27, 2024Updated last year
- A Streamlit app for exploring available AWS EC2 Capacity Blocks and SageMaker Training Plans across regions and instance types.☆23May 19, 2026Updated 2 months ago
- A really simple Spring Boot app, for demos. Displays information about cheese, for some reason.☆10Jun 12, 2026Updated last month
- This guidance demonstrates how to build a FinOps agent using Amazon Bedrock's multi-agent capability and Amazon Nova foundation models to…☆18Aug 20, 2025Updated 11 months ago
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- Chainlit application built using AWS CDK, secured with Amazon Cognito, that allows you to interact with Anthropic's Claude language model…☆36Feb 11, 2026Updated 5 months ago
- ☆29Dec 19, 2024Updated last year
- File Level Backup of apps running on Openshift / Kubernetes☆15Apr 25, 2019Updated 7 years ago
- This Guidance demonstrates how enterprises can unlock the value of their data through the powerful generative AI capabilities of Amazon Q…☆19Jun 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- GCO is a platform that spins up EKS Auto Mode clusters across AWS regions, wired together with Global Accelerator for low-latency routing…☆39Updated this week
- Jupyter notebook containing code from text preprocessing blog post☆10Nov 29, 2016Updated 9 years ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- Run Haystack Pipelines on Ray☆20Oct 16, 2024Updated last year
- ☆172Jun 23, 2026Updated last month
- ☆74Jun 9, 2026Updated last month
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆97Updated this week
- Content repository for Community.aws☆51Nov 27, 2024Updated last year
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆14Dec 15, 2025Updated 7 months ago
- Alternative password shadowing scheme☆10Jul 20, 2026Updated last week
- Awesome List / Resources for Account Abstraction☆10Dec 14, 2022Updated 3 years ago
- A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for…☆89Updated this week
- Production-ready deployment patterns for running OpenAI Codex at enterprise scale on Amazon Bedrock — with corporate SSO, optional quota …☆25Updated this week
- This Guidance provides a sample foundation for building real-time voice AI agents on AWS. It demonstrates how to build a voice assistant …☆47Jun 17, 2026Updated last month
- This project shows how to implement a simple SaaS metering system on AWS☆14Apr 15, 2025Updated last year