aws-samples / sample-serverless-llama-serverLinks
Serverless LLM Inference: Deploy DeepSeek R1 & LLaMA Models on AWS Lambda with Ultra-Fast Cold Starts
☆12Updated 3 months ago
Alternatives and similar repositories for sample-serverless-llama-server
Users that are interested in sample-serverless-llama-server are comparing it to the libraries listed below
Sorting:
- Nodejs agent for Sidekick open-source live application debugger☆12Updated 2 years ago
- Python agent for Sidekick open-source live application debugger☆15Updated 2 years ago
- Middy middleware for Model Context Protocol server hosting on AWS Lambda☆38Updated 7 months ago
- Run any AWS Lambda function as a Large Language Model (LLM) tool without code changes using Anthropic's Model Context Protocol (MCP).☆112Updated 8 months ago
- Build Agentic AI solutions on AWS, using latest OSS Agentic Frameworks.☆211Updated last week
- Automate the creation of soccer match highlights with the power of Generative AI and AWS. This solution leverages AWS Bedrock (Anthropic…☆21Updated last year
- Creates a simple MCP tool server with "streaming" HTTP.☆232Updated 6 months ago
- This project provides and example of end to end data processing application created using the combination of Amazon Managed Streaming for…☆44Updated 2 years ago
- ☆16Updated last year
- A NodeJS package for running code in parallel. Initially created to provide multiprocessing in an AWS Lambda function, but it can be used…☆15Updated 2 years ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆180Updated 5 months ago
- A full-stack serverless RAG workflow. This is thought for running PoCs, prototypes and bootstrap your MVP.☆86Updated last year
- Collection of examples of how to use Model Context Protocol with AWS.☆98Updated 2 weeks ago
- Fully managed RAG solution implemented using Knowledge Bases for Amazon Bedrock☆177Updated 3 weeks ago
- Invoking models on Amazon Bedrock using Rust☆68Updated 8 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 8 months ago
- ☆231Updated last year
- Middy middleware for accessing current AWS Lambda invocation event and context from anywhere☆11Updated 3 years ago
- A demo ChatBot application developed using Amazon Bedrock service's KnowledgeBase, Agent and other AWS's serveless GenAI solution.☆124Updated last month
- Workshop Studio☆157Updated 2 years ago
- Powertools for AWS's official MCP Server☆40Updated last week
- Guidance for Clickstream Analytics on AWS source code☆86Updated 2 months ago
- Cloud-native, AI-powered, document processing pipelines on AWS.☆185Updated 9 months ago
- 🤖 🧑💻 🛠️ A curated list of awesome things related to Amazon Q Developer☆157Updated 3 months ago
- Repository contains lists of Threads users separated by categories.☆23Updated last year
- Sample implementations of AI Agents and MCP Servers running on AWS Serverless compute☆223Updated 2 weeks ago
- ☆54Updated last month
- Generative AI Application Builder on AWS facilitates the development, rapid experimentation, and deployment of generative artificial inte…☆307Updated last week
- Run existing Model Context Protocol (MCP) stdio-based servers in AWS Lambda functions☆341Updated this week
- ☆42Updated last year