aws / sagemaker-huggingface-inference-toolkit

Related projects ⓘ

Alternatives and complementary repositories for sagemaker-huggingface-inference-toolkit

• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆209Updated this week
• aws / sagemaker-pytorch-inference-toolkit
  Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…
  ☆134Updated last month
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆127Updated last month
• aws-neuron / transformers-neuronx
  ☆100Updated 2 months ago
• cohere-ai / cohere-aws
  ☆58Updated this week
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆223Updated 2 months ago
• aws / sagemaker-inference-toolkit
  Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
  ☆391Updated last year
• aws-samples / zero-administration-inference-with-aws-lambda-for-hugging-face
  Zero administration inference with AWS Lambda for 🤗
  ☆63Updated 2 years ago
• aws-samples / sagemaker-distributed-training-workshop
  Hands-on workshop for distributed training and hosting on SageMaker
  ☆123Updated this week
• aws-samples / llm-apps-workshop
  Use LLMs for building real-world apps
  ☆109Updated 3 weeks ago
• philschmid / sagemaker-huggingface-llama-2-samples
  ☆87Updated last year
• aws-samples / amazon-sagemaker-local-mode
  Amazon SageMaker Local Mode Examples
  ☆248Updated 3 months ago
• awslabs / llm-hosting-container
  Large Language Model Hosting Container
  ☆78Updated 3 weeks ago
• aws-samples / mlops-sagemaker-github-actions
  MLOps example using Amazon SageMaker Pipeline and GitHub Actions
  ☆66Updated 6 months ago
• philschmid / huggingface-sagemaker-workshop-series
  Enterprise Scale NLP with Hugging Face & SageMaker Workshop series
  ☆234Updated last year
• philschmid / llm-sagemaker-sample
  ☆49Updated last month
• aws-samples / semantic-search-with-amazon-opensearch
  ☆115Updated this week
• aws / sagemaker-xgboost-container
  This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use th…
  ☆125Updated last month
• aws-samples / easy-amazon-sagemaker-deployments
  SageMaker custom deployments made easy
  ☆57Updated 10 months ago
• aws-samples / sagemaker-studio-auto-shutdown-extension
  ☆143Updated last year
• aws-samples / whisper-audio-inference-for-amazon-sagemaker
  This is a short example showing how to utilize Amazon SageMaker's real time endpoints with OpenAI's open source Whisper model for audio t…
  ☆64Updated last year
• aws-samples / hugging-face-workshop
  A 90-minute hands on workshop about Hugging Face on SageMaker.
  ☆28Updated 2 years ago
• aws / fmeval
  Foundation Model Evaluations Library
  ☆208Updated this week
• philschmid / cdk-samples
  ☆57Updated 2 years ago
• aws / sagemaker-training-toolkit
  Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
  ☆496Updated 2 months ago
• baileytec-labs / llama-on-lambda
  Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!
  ☆170Updated 7 months ago
• aws / sagemaker-tensorflow-serving-container
  A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.
  ☆172Updated last year
• aws-samples / sagemaker-genai-hosting-examples
  ☆46Updated this week
• aws / sagemaker-scikit-learn-container
  Support code for building and running Amazon SageMaker compatible Docker containers based on the open source framework Scikit-learn (http…
  ☆171Updated 2 weeks ago
• aws-samples / amazon-sagemaker-codeserver
  Hosting code-server on Amazon SageMaker
  ☆52Updated last year