aws / sagemaker-huggingface-inference-toolkitLinks
☆271Updated 9 months ago
Alternatives and similar repositories for sagemaker-huggingface-inference-toolkit
Users that are interested in sagemaker-huggingface-inference-toolkit are comparing it to the libraries listed below
Sorting:
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆142Updated last year
- Training and inference on AWS Trainium and Inferentia chips.☆259Updated last week
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆258Updated 7 months ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆412Updated 2 years ago
- Zero administration inference with AWS Lambda for 🤗☆63Updated 3 years ago
- Hands-on workshop for distributed training and hosting on SageMaker☆151Updated 3 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆157Updated 3 weeks ago
- ☆64Updated 9 months ago
- Foundation Model Evaluations Library☆276Updated 6 months ago
- Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆534Updated 3 weeks ago
- Amazon SageMaker Local Mode Examples☆263Updated 9 months ago
- Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!☆177Updated last year
- ☆111Updated last year
- ☆89Updated 2 years ago
- A generative AI-powered framework for testing virtual agents.☆337Updated last month
- Enterprise Scale NLP with Hugging Face & SageMaker Workshop series☆242Updated 3 years ago
- Use LLMs for building real-world apps☆112Updated last year
- Large Language Model Hosting Container☆91Updated 4 months ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆205Updated 5 months ago
- ☆47Updated last year
- This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use th…☆144Updated last week
- ☆134Updated last week
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆172Updated 2 years ago
- ☆45Updated 6 months ago
- Amazon SageMaker Managed Spot Training Examples☆51Updated last year
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆58Updated 3 years ago
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆154Updated this week
- ☆73Updated last year
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆254Updated 10 months ago
- SageMaker custom deployments made easy☆63Updated 10 months ago