☆272Apr 23, 2025Updated 10 months ago
Alternatives and similar repositories for sagemaker-huggingface-inference-toolkit
Users that are interested in sagemaker-huggingface-inference-toolkit are comparing it to the libraries listed below
Sorting:
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆412Nov 20, 2023Updated 2 years ago
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆142Oct 7, 2024Updated last year
- Large Language Model Hosting Container☆91Oct 9, 2025Updated 4 months ago
- Deploy Stable Diffusion Model on Amazon SageMaker Endpont☆38Feb 22, 2024Updated 2 years ago
- Sagemaker Studio Docker UI Extension☆11Apr 17, 2024Updated last year
- Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆535Jan 16, 2026Updated last month
- Training and inference on AWS Trainium and Inferentia chips.☆261Updated this week
- In this repo, we show how to host two computer vision models trained using the TensorFlow framework under one SageMaker multi-model endpo…☆12Jun 8, 2021Updated 4 years ago
- A universal scalable machine learning model deployment solution☆248Feb 28, 2026Updated last week
- ☆14Nov 1, 2024Updated last year
- Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.☆10,884Feb 24, 2026Updated last week
- Deploy, launch and use LLMs on AWS☆16Jun 2, 2023Updated 2 years ago
- ☆64Apr 25, 2025Updated 10 months ago
- Notebooks and sample code for Build On Trainium☆47Jan 14, 2026Updated last month
- Support code for building and running Amazon SageMaker compatible Docker containers based on the open source framework Scikit-learn (http…☆182Feb 12, 2026Updated 3 weeks ago
- Example code for AWS Neuron SDK developers building inference and training applications☆158Jan 15, 2026Updated last month
- Notebooks using the Hugging Face libraries 🤗☆4,474Feb 25, 2026Updated last week
- Port of Detectron2 to train/deploy model on Amazon Sagemaker☆16Mar 5, 2021Updated 5 years ago
- YoloV5 on SageMaker, including bring your own container☆18Nov 23, 2020Updated 5 years ago
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆3,305Feb 9, 2026Updated 3 weeks ago
- Multi Model Server is a tool for serving neural net models for inference☆1,025May 20, 2024Updated last year
- Enterprise Scale NLP with Hugging Face & SageMaker Workshop series☆242Jan 20, 2023Updated 3 years ago
- ☆24Aug 26, 2024Updated last year
- A Jupyter server extension to proxy requests with AWS SigV4 authentication☆22Jul 12, 2023Updated 2 years ago
- A set of Docker images that include popular frameworks for machine learning, data science and visualization.☆147Updated this week
- How to use stable diffusion model on AWS Sagemaker☆38Feb 23, 2023Updated 3 years ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆583Updated this week
- Amazon SageMaker Edge Manager Workshop☆36Jun 6, 2022Updated 3 years ago
- Compilation of examples of SageMaker inference options and other features.☆73Oct 28, 2025Updated 4 months ago
- Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…☆202Feb 27, 2026Updated last week
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆58Apr 18, 2022Updated 3 years ago
- ☆11Sep 20, 2021Updated 4 years ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆205Aug 25, 2025Updated 6 months ago
- Use the two different methods (deepspeed and SageMaker model parallelism library) to fine tune llama model on Sagemaker. Then deploy the …☆24Aug 1, 2023Updated 2 years ago
- ☆27Feb 25, 2022Updated 4 years ago
- Viewer for text datasets in formats like HuggingFace, JSONL, etc.☆15Feb 25, 2025Updated last year
- ☆14Nov 22, 2023Updated 2 years ago
- ☆12Sep 11, 2023Updated 2 years ago
- ☆13Oct 9, 2023Updated 2 years ago