aws / sagemaker-huggingface-inference-toolkitLinks
☆263Updated 2 months ago
Alternatives and similar repositories for sagemaker-huggingface-inference-toolkit
Users that are interested in sagemaker-huggingface-inference-toolkit are comparing it to the libraries listed below
Sorting:
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆141Updated 8 months ago
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆230Updated this week
- Zero administration inference with AWS Lambda for 🤗☆62Updated 3 years ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆407Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆149Updated 2 weeks ago
- Large Language Model Hosting Container☆89Updated 3 weeks ago
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆246Updated 3 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆141Updated 3 weeks ago
- ☆88Updated last year
- Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!☆174Updated last year
- Amazon SageMaker Local Mode Examples☆257Updated last month
- ☆44Updated last year
- ☆62Updated 2 months ago
- A 90-minute hands on workshop about Hugging Face on SageMaker.☆28Updated 3 years ago
- This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use th…☆139Updated 2 weeks ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆203Updated 3 weeks ago
- Foundation Model Evaluations Library☆256Updated 2 months ago
- A generative AI-powered framework for testing virtual agents.☆254Updated 2 months ago
- ☆72Updated last year
- Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆515Updated 2 weeks ago
- Hosting code-server on Amazon SageMaker☆54Updated last year
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆173Updated last year
- ☆130Updated this week
- Enterprise Scale NLP with Hugging Face & SageMaker Workshop series☆238Updated 2 years ago
- Use LLMs for building real-world apps☆113Updated 5 months ago
- Support code for building and running Amazon SageMaker compatible Docker containers based on the open source framework Scikit-learn (http…☆180Updated last month
- ☆104Updated this week
- ☆110Updated 5 months ago
- Amazon Bedrock Foundation models with Amazon Opensearch Serverless as a Vector DB☆192Updated last week
- CLI for building Docker images in SageMaker Studio using AWS CodeBuild.☆56Updated 3 years ago