aws / sagemaker-huggingface-inference-toolkitLinks
☆266Updated 4 months ago
Alternatives and similar repositories for sagemaker-huggingface-inference-toolkit
Users that are interested in sagemaker-huggingface-inference-toolkit are comparing it to the libraries listed below
Sorting:
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆236Updated this week
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆141Updated 10 months ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆407Updated last year
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆251Updated last month
- Zero administration inference with AWS Lambda for 🤗☆63Updated 3 years ago
- Enterprise Scale NLP with Hugging Face & SageMaker Workshop series☆241Updated 2 years ago
- ☆89Updated 2 years ago
- ☆62Updated 4 months ago
- Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆517Updated 2 weeks ago
- Example code for AWS Neuron SDK developers building inference and training applications☆148Updated last week
- Amazon SageMaker Local Mode Examples☆258Updated 3 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆146Updated 3 weeks ago
- ☆113Updated 7 months ago
- Foundation Model Evaluations Library☆262Updated 2 weeks ago
- Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!☆173Updated last year
- ☆131Updated last month
- A generative AI-powered framework for testing virtual agents.☆285Updated 4 months ago
- Large Language Model Hosting Container☆91Updated 2 weeks ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆205Updated 2 months ago
- This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use th…☆139Updated last week
- ☆44Updated 9 months ago
- AWS Deep Learning Containers are pre-built Docker images that make it easier to run popular deep learning frameworks and tools on AWS.☆1,096Updated this week
- ☆363Updated 9 months ago
- ☆59Updated 8 months ago
- Use LLMs for building real-world apps☆114Updated 7 months ago
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆172Updated last year
- ☆141Updated last year
- This repository contains examples of Docker images that can be used as custom images for KernelGateway Apps in SageMaker Studio☆133Updated 2 years ago
- ☆57Updated 3 years ago
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆148Updated 3 months ago