Alternatives and similar repositories for llm-evaluation-methodology

Users that are interested in llm-evaluation-methodology are comparing it to the libraries listed below

• aws / fmeval
  Foundation Model Evaluations Library
  ☆265Updated 2 months ago
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆148Updated 2 weeks ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆304Updated 7 months ago
• aws-samples / llm-apps-workshop
  Use LLMs for building real-world apps
  ☆112Updated 9 months ago
• aws-samples / aiml-genai-multimodal-agent
  ☆53Updated last year
• aws-samples / mlops-e2e
  MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK
  ☆149Updated 6 months ago
• aws-samples / foundation-model-benchmarking-tool
  Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…
  ☆254Updated 6 months ago
• build-on-aws / bedrock-agent-txt2sql
  Use natural language to Generate Amazon Athena SQL queries to fetch data.
  ☆94Updated 11 months ago
• aws-samples / amazon-sagemaker-generativeai
  Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…
  ☆173Updated this week
• cohere-ai / cohere-aws
  ☆63Updated 6 months ago
• awslabs / llmeter
  ☆30Updated last month
• aws-samples / amazon-sagemaker-llm-fine-tuning-remote-decorator
  ☆69Updated last month
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆150Updated 2 weeks ago
• arunprsh / knowledge-augmented-LLMs
  Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment
  ☆31Updated 2 years ago
• aws-samples / amazon-bedrock-rag-workshop
  Workshop Studio
  ☆156Updated last year
• aws-samples / aws-genai-conversational-rag-reference
  AWS Generative AI Conversational RAG Reference (Galileo)
  ☆80Updated 2 weeks ago
• aws-samples / sagemaker-studio-image-build-cli
  CLI for building Docker images in SageMaker Studio using AWS CodeBuild.
  ☆56Updated 3 years ago
• aws-samples / build-an-automated-large-language-model-evaluation-pipeline-on-aws
  ☆42Updated 6 months ago
• aws-samples / data-science-on-aws
  ☆141Updated last year
• aws-samples / sagemaker-studio-docker-cli-extension
  SageMaker Studio Docker CLI Extension
  ☆13Updated last year
• aws-samples / text-to-sql-bedrock-workshop
  This repository is intended for those looking to dive deep on advanced Text-to-SQL concepts.
  ☆126Updated 8 months ago
• aws-samples / genai-llm-application-monitoring-on-aws
  ☆24Updated last year
• aws-samples / sagemaker-genai-hosting-examples
  ☆124Updated this week
• aws-samples / aws-samples-for-ray
  ☆73Updated last year
• RamVegiraju / SageMaker-Deployment
  Compilation of examples of SageMaker inference options and other features.
  ☆69Updated this week
• aws-samples / mlops-multi-account-terraform
  Secure and scalable MLOps platform on AWS using Terraform.
  ☆41Updated 7 months ago
• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆26Updated last year
• aws-samples / semantic-search-with-amazon-opensearch
  ☆132Updated last month
• aws-samples / amazon-a2i-sample-task-uis
  Over 60 example task UIs for Amazon Augmented AI (A2I)
  ☆98Updated 4 years ago
• awslabs / rhubarb
  A Python framework for multi-modal document understanding with Amazon Bedrock
  ☆96Updated this week