gilinachum / bedrock-latencyLinks
Tools to measure latency for LLM in Amazon Bedrook
☆22Updated 3 months ago
Alternatives and similar repositories for bedrock-latency
Users that are interested in bedrock-latency are comparing it to the libraries listed below
Sorting:
- AWS Generative AI Conversational RAG Reference (Galileo)☆76Updated this week
- Use LLMs for building real-world apps☆112Updated 4 months ago
- ☆23Updated 2 months ago
- aws-solutions-library-samples / guidance-for-conversational-chatbots-using-retrieval-augmented-generation-on-awsThis Guidance demonstrates how to combine Retrieval Augmented Generation (RAG) with AWS services to build generative AI applications.☆40Updated 7 months ago
- Mistral on AWS examples for Bedrock & SageMaker☆70Updated last week
- ☆39Updated last month
- ☆23Updated 2 months ago
- Workshop Studio☆155Updated last year
- aws-solutions-library-samples / guidance-for-a-multi-tenant-generative-ai-gateway-with-cost-and-usage-tracking-on-awsThis Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆76Updated 7 months ago
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆101Updated 3 weeks ago
- ☆90Updated this week
- ☆62Updated 11 months ago
- A demo application that uses Amazon SageMaker manuals and pricing data tables as an example to explore the capabilities of a generative A…☆43Updated 6 months ago
- A generative AI-powered framework for testing virtual agents.☆239Updated 2 months ago
- ☆51Updated last month
- ☆26Updated last week
- ☆28Updated last year
- Advanced RAG patterns on Amazon SageMaker☆14Updated last year
- ☆63Updated 3 weeks ago
- A full-stack serverless RAG workflow. This is thought for running PoCs, prototypes and bootstrap your MVP.☆71Updated 6 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆241Updated last month
- ☆20Updated last year
- Deploy Generative AI models from Amazon SageMaker JumpStart using AWS CDK☆71Updated 2 weeks ago
- ☆19Updated last year
- A Python framework for multi-modal document understanding with Amazon Bedrock☆90Updated last week
- Try Artifacts and Code Interpreter Tool with Amazon Bedrock.☆99Updated last week
- How to build an advanced RAG router based assistant with Amazon Bedrock using LLMs, Embeddings model, and Knowledge Bases for Amazon Bedr…☆17Updated 6 months ago
- Use natural language to Generate Amazon Athena SQL queries to fetch data.☆77Updated 7 months ago
- Run any AWS Lambda function as a Large Language Model (LLM) tool without code changes using Anthropic's Model Context Protocol (MCP).☆102Updated 2 months ago
- Creating Amazon Bedrock agents with Streamlit Framework☆119Updated 3 months ago