aws-solutions-library-samples / guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksLinks
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
☆18Updated this week
Alternatives and similar repositories for guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Users that are interested in guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks are comparing it to the libraries listed below
Sorting:
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆48Updated 4 months ago
- Build a custom user interface for more tailored, controlled, and consolidated interactions with Amazon Q business.☆53Updated 11 months ago
- Mistral on AWS examples for Bedrock & SageMaker☆85Updated this week
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆35Updated last month
- ☆81Updated last year
- This Guidance demonstrates how to securely run Model Context Protocol (MCP) servers on the AWS Cloud using containerized architecture. It…☆119Updated last month
- A demo ChatBot application developed using Amazon Bedrock service's KnowledgeBase, Agent and other AWS's serveless GenAI solution.☆118Updated last week
- AWS Well-Architected Framework Review (WAFR) Acceleration with Generative AI (GenAI) sample.☆79Updated 3 weeks ago
- ☆39Updated 11 months ago
- Build Agentic AI solutions on AWS, using latest OSS Agentic Frameworks.☆181Updated last week
- AI on EKS - Tested AI/ML for Amazon Elastic Kubernetes Service☆130Updated this week
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆165Updated 3 months ago
- This repo provides sample generative AI stacks built atop the AWS Generative AI CDK Constructs.☆152Updated last week
- Personal Chatbot powered by Amazon Bedrock LLMs with a data analytics feature that provides isolated servereless compute on Athena Spark …☆95Updated last month
- ☆63Updated 2 years ago
- CDK AWS Observability Accelerator☆149Updated 2 months ago
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆85Updated last year
- ☆54Updated last month
- This repository contains sample code demonstrating various use cases leveraging Amazon Bedrock and Generative AI. Each sample is a separa…☆385Updated last week
- Building SA AI Agent v2☆80Updated 11 months ago
- Content repository for Community.aws☆50Updated 10 months ago
- Discover how to build agents that can perform actions on websites by combining Amazon Nova Act with Model Context Protocol (MCP).☆73Updated last month
- ☆23Updated 2 weeks ago
- Cloud-native, AI-powered, document processing pipelines on AWS.☆186Updated 7 months ago
- Amazon Bedrock Foundation models with Amazon Opensearch Serverless as a Vector DB☆202Updated last month
- 🤖 🧑💻 🛠️ A curated list of awesome things related to Amazon Q Developer☆150Updated last month
- Elevate Your DevOps Pipeline with Generative AI☆24Updated 8 months ago
- Pre-built examples of Generative AI agents with Bedrock across multiple industries.☆46Updated 4 months ago
- ☆67Updated this week
- ☆67Updated last year