Alternatives and similar repositories for llmperf

Users that are interested in llmperf are comparing it to the libraries listed below

• huggingface / optimum-neuron
  Training and inference on AWS Trainium and Inferentia chips.
  ☆250Updated last week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆151Updated last week
• aws-neuron / transformers-neuronx
  ☆111Updated 10 months ago
• aws-samples / sagemaker-hosting
  ☆44Updated 4 months ago
• aws / sagemaker-huggingface-inference-toolkit
  ☆270Updated 7 months ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆320Updated last month
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆23Updated last month
• aws / fmeval
  Foundation Model Evaluations Library
  ☆272Updated 4 months ago
• aws-samples / awsome-inference
  ☆57Updated this week
• aws-samples / amazon-sagemaker-managed-spot-training
  Amazon SageMaker Managed Spot Training Examples
  ☆51Updated last year
• aws-samples / llm-evaluation-methodology
  ☆46Updated last year
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆151Updated last month
• awslabs / llmeter
  ☆33Updated this week
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆141Updated last year
• aws-samples / sagemaker-studio-image-build-cli
  CLI for building Docker images in SageMaker Studio using AWS CodeBuild.
  ☆58Updated 3 years ago
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆258Updated 5 months ago
• aws-samples / aws-do-eks
  Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…
  ☆63Updated last week
• aws-samples / Cohere-on-AWS
  ☆27Updated last month
• cohere-ai / cohere-aws
  ☆64Updated 7 months ago
• aws-samples / sagemaker-genai-hosting-examples
  ☆129Updated 2 weeks ago
• yuhuiaws / finetuning-and-deploying-llama-on-Sagemaker
  Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the …
  ☆24Updated 2 years ago
• aws-samples / foundation-model-benchmarking-tool
  Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…
  ☆254Updated 8 months ago
• aws-samples / aws-samples-for-ray
  ☆73Updated last year
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆89Updated 2 years ago
• aws-samples / training-llm-on-sagemaker-for-multiple-nodes-with-deepspeed
  ☆26Updated last year
• aws-neuron / neuronx-nemo-megatron
  ☆39Updated 11 months ago
• aws-samples / sagemaker-studio-apps-lifecycle-config-examples
  ☆30Updated 2 months ago
• aws-neuron / aws-neuron-eks-samples
  ☆25Updated 2 weeks ago
• aws-samples / generative-ai-workshop-build-a-multifunctional-chatbot-on-sagemaker
  ☆45Updated 9 months ago
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆43Updated 2 years ago