aws-solutions-library-samples / guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksView on GitHub
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
☆20Sep 4, 2026Updated 2 months ago
Alternatives and similar repositories for guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Users that are interested in guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆23Oct 9, 2026Updated 3 weeks ago
- ☆20Oct 31, 2026Updated last week
- ☆18Sep 20, 2026Updated last month
- This repository shows you how to build real-time, voice-enabled AI agents with Pipecat and Amazon Bedrock☆38Mar 30, 2026Updated 7 months ago
- Inspired by Tony Stark's robotic assistant Dum-E, the mission of this project is to create an intelligent, voice & vision enabled AI agen…☆27Sep 14, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Official AWS Startups repository that hosts plugins, skills, tools and resources to support startup builders on AWS☆25Oct 26, 2026Updated last week
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆19Jan 29, 2024Updated 2 years ago
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆44Feb 18, 2026Updated 8 months ago
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆39May 21, 2024Updated 2 years ago
- ☆18Apr 13, 2026Updated 6 months ago
- This GenAI solution enables users to extract insights from diverse data formats (video, audio, PDFs, text) through a unified interface. U…☆22Feb 12, 2026Updated 8 months ago
- 🚀 Experimental AI demos showcasing Amazon Bedrock, open-source LLMs & creative possibilities. AI Agents, RAG systems, streaming agents &…☆45Updated this week
- This Guidance demonstrates how to transform architecture diagrams into Infrastructure as Code (IaC) templates using AI, addressing the ch…☆49Aug 20, 2026Updated 2 months ago
- This project automates the text extraction, transcription and summarization of audio, video, and documents using Amazon Bedrock, Amazon T…☆18Sep 27, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This guidance demonstrates how to build a FinOps agent using Amazon Bedrock's multi-agent capability and Amazon Nova foundation models to…☆19Aug 20, 2025Updated last year
- ☆29Dec 19, 2024Updated last year
- Tutorials and labs focused on educating users☆11Sep 6, 2023Updated 3 years ago
- ☆10Oct 28, 2026Updated last week
- File Level Backup of apps running on Openshift / Kubernetes☆15Apr 25, 2019Updated 7 years ago
- Basic Operator Building Tutorial☆11Jun 17, 2020Updated 6 years ago
- Jupyter notebook containing code from text preprocessing blog post☆10Nov 29, 2016Updated 9 years ago
- This Guidance demonstrates how enterprises can unlock the value of their data through the powerful generative AI capabilities of Amazon Q…☆19Jun 24, 2025Updated last year
- Awesome List / Resources for Account Abstraction☆10Dec 14, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- This Guidance demonstrates how to aggregate public, open-source code repositories into a central location to customize Amazon Q Developer…☆13Jul 23, 2026Updated 3 months ago
- CLI for exploring Amazon Bedrock OpenAI-compatible APIs☆13Dec 16, 2025Updated 10 months ago
- ☆10Sep 30, 2024Updated 2 years ago
- ☆25Updated this week
- AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed.☆53Updated this week
- dApp authentication with Amazon Cognito and Web3 proxy with Amazon API Gateway☆15Aug 5, 2024Updated 2 years ago
- An AWS Cloud Development Kit (CDK) sample showing how to configure the aws_lambda extension to send outgoing webhooks via Amazon EventBri…☆16Jul 24, 2026Updated 3 months ago
- ☆14Mar 18, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Production-ready deployment patterns for running OpenAI Codex at enterprise scale on Amazon Bedrock — with corporate SSO, optional quota …☆28Aug 18, 2026Updated 2 months ago
- CDK AWS Observability Accelerator☆152Jul 24, 2026Updated 3 months ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆53Jun 17, 2025Updated last year
- ☆14Aug 10, 2026Updated 2 months ago
- Alternative password shadowing scheme☆13Oct 11, 2026Updated 3 weeks ago
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆100Jul 28, 2026Updated 3 months ago
- The Amazon S3 Glacier Re:Freezer is a serverless solution that automatically copies entire Amazon S3 Glacier vault archives to a defined …☆20Jan 29, 2024Updated 2 years ago