Alternatives and similar repositories for sagemaker-huggingface-inference-toolkit:

Users that are interested in sagemaker-huggingface-inference-toolkit are comparing it to the libraries listed below

• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆138Updated 6 months ago
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆228Updated this week
• aws / sagemaker-inference-toolkit
  Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
  ☆403Updated last year
• aws-samples / zero-administration-inference-with-aws-lambda-for-hugging-face
  Zero administration inference with AWS Lambda for 🤗
  ☆61Updated 3 years ago
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆141Updated 3 weeks ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆87Updated 2 weeks ago
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆88Updated last year
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆241Updated last month
• awslabs / agent-evaluation
  A generative AI-powered framework for testing virtual agents.
  ☆217Updated 3 weeks ago
• aws / fmeval
  Foundation Model Evaluations Library
  ☆244Updated 2 weeks ago
• cohere-ai / cohere-aws
  ☆62Updated last week
• aws / sagemaker-pytorch-training-toolkit
  Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…
  ☆203Updated 2 months ago
• aws-samples / sagemaker-studio-auto-shutdown-extension
  ☆145Updated 2 years ago
• aws-neuron / transformers-neuronx
  ☆105Updated 3 months ago
• baileytec-labs / llama-on-lambda
  Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!
  ☆173Updated last year
• aws-samples / amazon-sagemaker-local-mode
  Amazon SageMaker Local Mode Examples
  ☆255Updated last week
• aws-samples / sagemaker-hosting
  ☆44Updated 11 months ago
• philschmid / huggingface-sagemaker-workshop-series
  Enterprise Scale NLP with Hugging Face & SageMaker Workshop series
  ☆236Updated 2 years ago
• aws-samples / llm-apps-workshop
  Use LLMs for building real-world apps
  ☆110Updated 3 months ago
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆136Updated last week
• aws-samples / mlops-e2e
  MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK
  ☆140Updated 2 weeks ago
• aws-samples / semantic-search-with-amazon-opensearch
  ☆121Updated 4 months ago
• aws-samples / AI-search-with-amazon-opensearch-service
  ☆48Updated this week
• aws-samples / amazon-sagemaker-deploy-nlp-huggingface
  ☆12Updated last year
• aws-samples / amazon-sagemaker-llm-fine-tuning-remote-decorator
  ☆59Updated 3 weeks ago
• aws-samples / amazon-sagemaker-codeserver
  Hosting code-server on Amazon SageMaker
  ☆54Updated last year
• philschmid / llm-sagemaker-sample
  ☆56Updated 4 months ago
• aws-samples / llm-evaluation-methodology
  ☆43Updated 5 months ago
• aws-samples / sagemaker-custom-project-templates
  ☆222Updated 8 months ago
• aws-samples / sagemaker-studio-custom-image-samples
  This repository contains examples of Docker images that can be used as custom images for KernelGateway Apps in SageMaker Studio
  ☆130Updated 2 years ago