aws-solutions-library-samples / guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksView on GitHub
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
☆19Sep 4, 2026Updated last month
Alternatives and similar repositories for guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Users that are interested in guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆23Oct 9, 2026Updated last week
- This Guidance demonstrates how to build an AI-assisted robot training and fleet management system using Amazon Bedrock foundation models …☆22Jul 23, 2026Updated 2 months ago
- This repository shows you how to build real-time, voice-enabled AI agents with Pipecat and Amazon Bedrock☆38Mar 30, 2026Updated 6 months ago
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆45May 29, 2025Updated last year
- Amazon ECS Auto Scaling for GPU-based Machine Learning Workloads☆19Jan 29, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆44Feb 18, 2026Updated 8 months ago
- ☆18Apr 13, 2026Updated 6 months ago
- 🚀 Experimental AI demos showcasing Amazon Bedrock, open-source LLMs & creative possibilities. AI Agents, RAG systems, streaming agents &…☆42Updated this week
- Implementing a fast scaling and low cost Stable Diffusion inference solution with serverless and containers on AWS☆39May 21, 2024Updated 2 years ago
- This Guidance demonstrates how to transform architecture diagrams into Infrastructure as Code (IaC) templates using AI, addressing the ch…☆49Aug 20, 2026Updated last month
- A really simple Spring Boot app, for demos. Displays information about cheese, for some reason.☆10Aug 22, 2026Updated last month
- A Streamlit app for exploring available AWS EC2 Capacity Blocks and SageMaker Training Plans across regions and instance types.☆33Sep 26, 2026Updated 3 weeks ago
- ☆13Apr 6, 2023Updated 3 years ago
- "Docs 2.1" docs-as-code boilerplate☆18Mar 9, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Chainlit application built using AWS CDK, secured with Amazon Cognito, that allows you to interact with Anthropic's Claude language model…☆36Feb 11, 2026Updated 8 months ago
- ☆29Dec 19, 2024Updated last year
- ☆14May 19, 2023Updated 3 years ago
- This Guidance demonstrates how enterprises can unlock the value of their data through the powerful generative AI capabilities of Amazon Q…☆20Jun 24, 2025Updated last year
- AI/ML and HPC at planetary scale. One API. Every Accelerator. Any Region. MIT-0 licensed☆50Updated this week
- Jupyter notebook containing code from text preprocessing blog post☆10Nov 29, 2016Updated 9 years ago
- Repo public contenant le code source des packages d'Extinction-MiniJeux pour Windows et Mac☆12Feb 1, 2026Updated 8 months ago
- Workshop on building an operator.☆14Jul 27, 2020Updated 6 years ago
- ☆177Sep 28, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An AWS Cloud Development Kit (CDK) sample showing how to configure the aws_lambda extension to send outgoing webhooks via Amazon EventBri…☆16Jul 24, 2026Updated 2 months ago
- ☆16Dec 4, 2019Updated 6 years ago
- Awesome List / Resources for Account Abstraction☆10Dec 14, 2022Updated 3 years ago
- Production-ready deployment patterns for running OpenAI Codex at enterprise scale on Amazon Bedrock — with corporate SSO, optional quota …☆28Aug 18, 2026Updated last month
- This project shows how to implement a simple SaaS metering system on AWS☆14Jul 28, 2026Updated 2 months ago
- dApp authentication with Amazon Cognito and Web3 proxy with Amazon API Gateway☆15Aug 5, 2024Updated 2 years ago
- ☆18May 8, 2025Updated last year
- This project is an example of using AWS Step functions to manage and track a series of AWS Batch jobs in N_TO_N mode.☆15Jan 20, 2026Updated 8 months ago
- ☆41Apr 27, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Deploy and manage a self-hosted LLM using EKS.☆17Jan 29, 2025Updated last year
- The Amazon S3 Glacier Re:Freezer is a serverless solution that automatically copies entire Amazon S3 Glacier vault archives to a defined …☆20Jan 29, 2024Updated 2 years ago
- This GitHub repository hosts the artifacts for the AWS Containers blog on developing Twelve Factor Apps on ECS using Fargate.☆23May 1, 2023Updated 3 years ago
- This Guidance demonstrates how organizations can implement secure enterprise authentication for Amazon Bedrock using industry-standard pr…☆407Oct 9, 2026Updated last week
- ☆15Jul 5, 2022Updated 4 years ago
- ☆11Jun 1, 2022Updated 4 years ago
- Practical content from 6.419 - Data Analysis: Statistical Modeling and Computation in Applications course from the MicroMasters in Statis…☆10Mar 30, 2021Updated 5 years ago