Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
☆255Apr 11, 2025Updated 10 months ago
Alternatives and similar repositories for foundation-model-benchmarking-tool
Users that are interested in foundation-model-benchmarking-tool are comparing it to the libraries listed below
Sorting:
- Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously☆15Apr 11, 2025Updated 10 months ago
- ☆57Feb 5, 2026Updated 3 weeks ago
- ☆133Feb 20, 2026Updated last week
- Foundation Model Evaluations Library☆276Aug 7, 2025Updated 6 months ago
- ☆31Oct 17, 2024Updated last year
- ☆41Aug 27, 2024Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆158Jan 15, 2026Updated last month
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆396Updated this week
- This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gat…☆199Jul 8, 2025Updated 7 months ago
- A modular and comprehensive solution to deploy a Multi-LLM and Multi-RAG powered chatbot (Amazon Bedrock, Anthropic, HuggingFace, OpenAI,…☆1,374Feb 20, 2026Updated last week
- ☆113Feb 19, 2026Updated last week
- CMP314 Optimizing NLP models with Amazon EC2 Inf1 instances in Amazon Sagemaker☆14Dec 20, 2023Updated 2 years ago
- ☆47Oct 29, 2024Updated last year
- This repository contains examples for customers to get started using the Amazon Bedrock Service. This contains examples for all available…☆1,377Updated this week
- This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like…☆90Oct 20, 2024Updated last year
- The Generative AI Assets Catalog is an organized repository designed for individuals seeking to explore the newest content released by AW…☆16Aug 22, 2025Updated 6 months ago
- OpenAI-Compatible RESTful APIs for Amazon Bedrock☆939Updated this week
- ☆45Feb 22, 2025Updated last year
- ☆27May 13, 2025Updated 9 months ago
- This GitHub repository guides you through building an advanced Conversational AI assistant using AWS services and Anthropic's Claude V2 m…☆31May 17, 2024Updated last year
- ☆11Feb 1, 2024Updated 2 years ago
- ☆110Jan 16, 2025Updated last year
- Training and inference on AWS Trainium and Inferentia chips.☆261Updated this week
- ☆20Dec 9, 2025Updated 2 months ago
- LLM inference solution for Amazon Dedicated Cloud (LISA).☆78Updated this week
- ☆241Feb 6, 2026Updated 3 weeks ago
- Tools to measure latency for LLM in Amazon Bedrook☆22Jan 20, 2026Updated last month
- FM-Leaderboard-er allows you to create leaderboard to find the best LLM/prompt for your own business use case based on your data, task, p…☆19Oct 31, 2024Updated last year
- Cluster doctor skills☆14Feb 20, 2026Updated last week
- This is a workshop designed for Amazon Bedrock a foundational model service.☆2,088Nov 13, 2025Updated 3 months ago
- This repository aims to showcase how to finetune a FM model in Amazon EKS cluster using, JupyterHub to provision notebooks and craft both…☆52Jun 17, 2025Updated 8 months ago
- ☆52Jul 19, 2023Updated 2 years ago
- Build complex, serverless, and highly scalable generative AI applications with prompt chaining.☆318Feb 6, 2026Updated 3 weeks ago
- ☆33Updated this week
- ☆13Dec 19, 2025Updated 2 months ago
- ☆42Apr 27, 2025Updated 10 months ago
- ☆77Feb 24, 2026Updated last week
- AWS-native chatbot using Bedrock☆1,272Updated this week
- Pre-built examples of Generative AI agents with Bedrock across multiple industries.☆48Jan 8, 2026Updated last month