aws-samples / sample-serverless-llama-serverLinks
Serverless LLM Inference: Deploy DeepSeek R1 & LLaMA Models on AWS Lambda with Ultra-Fast Cold Starts
☆12Updated this week
Alternatives and similar repositories for sample-serverless-llama-server
Users that are interested in sample-serverless-llama-server are comparing it to the libraries listed below
Sorting:
- ☆113Updated this week
- Build Agentic AI solutions on AWS, using latest OSS Agentic Frameworks.☆220Updated last week
- Nodejs agent for Sidekick open-source live application debugger☆12Updated 3 years ago
- Run any AWS Lambda function as a Large Language Model (LLM) tool without code changes using Anthropic's Model Context Protocol (MCP).☆111Updated 10 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 9 months ago
- ☆17Updated 2 years ago
- Cloud-native, AI-powered, document processing pipelines on AWS.☆186Updated 2 weeks ago
- ☆23Updated 2 weeks ago
- Creates a simple MCP tool server with "streaming" HTTP.☆232Updated 7 months ago
- ☆237Updated last week
- Fully managed RAG solution implemented using Knowledge Bases for Amazon Bedrock☆187Updated 2 weeks ago
- Run existing Model Context Protocol (MCP) stdio-based servers in AWS Lambda functions☆346Updated this week
- Agent samples built using the Strands Agents SDK.☆633Updated this week
- Generative AI Application Builder on AWS facilitates the development, rapid experimentation, and deployment of generative artificial inte…☆318Updated last week
- ☆18Updated 2 years ago
- Workshop Studio☆159Updated 2 years ago
- Sample implementations of AI Agents and MCP Servers running on AWS Serverless compute☆228Updated this week
- Amazon Bedrock Foundation models with Amazon Opensearch Serverless as a Vector DB☆215Updated last week
- A demo ChatBot application developed using Amazon Bedrock service's KnowledgeBase, Agent and other AWS's serveless GenAI solution.☆125Updated 3 months ago
- End to end example of a Retail Agent implemented with agents for Amazon Bedrock☆37Updated last year
- ☆42Updated last year
- A full-stack serverless RAG workflow. This is thought for running PoCs, prototypes and bootstrap your MVP.☆87Updated last year
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆191Updated 6 months ago
- ☆43Updated last week
- ☆89Updated 8 months ago
- This project provides and example of end to end data processing application created using the combination of Amazon Managed Streaming for…☆45Updated 3 years ago
- Build complex, serverless, and highly scalable generative AI applications with prompt chaining.☆318Updated this week
- Demo of Anthropic's open source MCP used with Amazon Bedrock Converse API☆94Updated last year
- ☆26Updated 2 months ago
- Mistral on AWS examples for Bedrock & SageMaker☆89Updated last week