aws-solutions-library-samples / guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eksLinks
Comprehensive, scalable ML inference architecture using Amazon EKS, leveraging Graviton processors for cost-effective CPU-based inference and GPU instances for accelerated inference. Guidance provides a complete end-to-end platform for deploying LLMs with agentic AI capabilities, including RAG and MCP
☆19Updated 2 weeks ago
Alternatives and similar repositories for guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks
Users that are interested in guidance-for-scalable-model-inference-and-agentic-ai-on-amazon-eks are comparing it to the libraries listed below
Sorting:
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆51Updated 5 months ago
- ☆40Updated last year
- A demo ChatBot application developed using Amazon Bedrock service's KnowledgeBase, Agent and other AWS's serveless GenAI solution.☆124Updated last month
- Build Agentic AI solutions on AWS, using latest OSS Agentic Frameworks.☆207Updated this week
- Build a custom user interface for more tailored, controlled, and consolidated interactions with Amazon Q business.☆53Updated last year
- ☆82Updated 2 years ago
- AI on EKS - Tested AI/ML for Amazon Elastic Kubernetes Service☆139Updated this week
- Mistral on AWS examples for Bedrock & SageMaker☆86Updated last week
- aws-solutions-library-samples / guidance-for-developing-data-and-ai-foundation-with-amazon-sagemakerDAIVI is a reference solution with IAC modules to accelerate development of Data, Analytics, AI and Visualization applications on AWS usi…☆38Updated 2 months ago
- ☆70Updated last week
- Content repository for Community.aws☆49Updated last year
- aws-solutions-library-samples / guidance-for-natural-language-queries-of-relational-databases-on-awsDemonstration of Natural Language Query (NLQ) of an Amazon RDS for PostgreSQL database, using SageMaker JumpStart, Amazon Bedrock, LangCh…☆70Updated last year
- Learn how to quickly build Agents with Amazon Bedrock☆102Updated last year
- The Generative AI Assets Catalog is an organized repository designed for individuals seeking to explore the newest content released by AW…☆16Updated 3 months ago
- This Guidance demonstrates how to securely run Model Context Protocol (MCP) servers on the AWS Cloud using containerized architecture. It…☆132Updated last week
- ☆18Updated 2 years ago
- CDK AWS Observability Accelerator☆150Updated last week
- This repo provides sample generative AI stacks built atop the AWS Generative AI CDK Constructs.☆154Updated last week
- AWS Well-Architected Framework Review (WAFR) Acceleration with Generative AI (GenAI) sample.☆84Updated 2 months ago
- ☆27Updated last year
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆89Updated last year
- Deploy Generative AI models from Amazon SageMaker JumpStart using AWS CDK☆72Updated 6 months ago
- Sample implementations of AI Agents and MCP Servers running on AWS Serverless compute☆220Updated last week
- ☆54Updated 2 months ago
- A generic Streamlit UI for testing generative AI agents built using Agents for Amazon Bedrock☆31Updated 7 months ago
- Elevate Your DevOps Pipeline with Generative AI☆24Updated 9 months ago
- Personal Chatbot powered by Amazon Bedrock LLMs with a data analytics feature that provides isolated servereless compute on Athena Spark …☆98Updated 2 months ago
- ☆42Updated 7 months ago
- Collections of examples of using Terraform with AWS☆14Updated 9 months ago
- A sample agentic ai platform to run agentic workflows on AWS using either EKS or Bedrock AgentCore with open source frameworks like LangC…☆51Updated last month