Alternatives and similar repositories for llmperf

Users that are interested in llmperf are comparing it to the libraries listed below

• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆157Updated 3 weeks ago
• aws-neuron / transformers-neuronx
  ☆111Updated last year
• huggingface / optimum-neuron
  Training and inference on AWS Trainium and Inferentia chips.
  ☆259Updated this week
• aws / sagemaker-huggingface-inference-toolkit
  ☆271Updated 9 months ago
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆336Updated last month
• aws-samples / sagemaker-hosting
  ☆45Updated 6 months ago
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆142Updated last year
• awslabs / llmeter
  ☆34Updated 2 months ago
• aws-samples / llm-evaluation-methodology
  ☆47Updated last year
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆258Updated 7 months ago
• aws / fmeval
  Foundation Model Evaluations Library
  ☆276Updated 6 months ago
• yuhuiaws / finetuning-and-deploying-llama-on-Sagemaker
  Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the …
  ☆24Updated 2 years ago
• aws-neuron / aws-neuron-sagemaker-samples
  ☆13Updated last month
• aws-samples / awsome-inference
  ☆57Updated 2 weeks ago
• aws-samples / sagemaker-studio-image-build-cli
  CLI for building Docker images in SageMaker Studio using AWS CodeBuild.
  ☆58Updated 3 years ago
• aws-neuron / aws-neuron-eks-samples
  ☆25Updated this week
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆25Updated 3 months ago
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆151Updated 3 months ago
• aws-samples / foundation-model-benchmarking-tool
  Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…
  ☆254Updated 9 months ago
• aws-samples / aws-distributed-training-workshop-eks
  Create an Amazon EKS cluster and run a distributed training example
  ☆29Updated last year
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆89Updated 2 years ago
• aws-neuron / neuronx-nemo-megatron
  ☆39Updated last year
• aws-samples / ray-serve-whisper-streaming-on-eks
  ☆34Updated 10 months ago
• aws-samples / sagemaker-genai-hosting-examples
  ☆132Updated 2 weeks ago
• aws-samples / mistral-on-aws
  Mistral on AWS examples for Bedrock & SageMaker
  ☆89Updated last week
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆43Updated 2 years ago
• aws-samples / aws-do-eks
  Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…
  ☆64Updated 2 weeks ago
• aws-samples / amazon-sagemaker-local-mode
  Amazon SageMaker Local Mode Examples
  ☆263Updated 9 months ago
• amazon-science / auto-rag-eval
  Code repo for the ICML 2024 paper "Automated Evaluation of Retrieval-Augmented Language Models with Task-Specific Exam Generation"
  ☆86Updated last year
• aws-samples / semantic-search-with-amazon-opensearch
  ☆134Updated last week