aws / sagemaker-huggingface-inference-toolkit
☆245Updated 4 months ago
Alternatives and similar repositories for sagemaker-huggingface-inference-toolkit:
Users that are interested in sagemaker-huggingface-inference-toolkit are comparing it to the libraries listed below
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆218Updated this week
- Example code for AWS Neuron SDK developers building inference and training applications☆135Updated last week
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆136Updated 4 months ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆397Updated last year
- Zero administration inference with AWS Lambda for 🤗☆63Updated 2 years ago
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆231Updated 2 months ago
- ☆102Updated last month
- ☆88Updated last year
- Large Language Model Hosting Container☆83Updated last week
- Hands-on workshop for distributed training and hosting on SageMaker☆131Updated this week
- Enterprise Scale NLP with Hugging Face & SageMaker Workshop series☆235Updated 2 years ago
- Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆503Updated last week
- ☆145Updated 2 years ago
- Use LLMs for building real-world apps☆111Updated last month
- ☆119Updated 2 months ago
- ☆61Updated 3 weeks ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆201Updated last week
- Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!☆173Updated 10 months ago
- This repository contains examples of Docker images that can be used as custom images for KernelGateway Apps in SageMaker Studio☆128Updated last year
- A generative AI-powered framework for testing virtual agents.☆170Updated last month
- Foundation Model Evaluations Library☆230Updated last week
- This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use th…☆133Updated last month
- Amazon SageMaker Local Mode Examples☆252Updated last week
- MLOps example using Amazon SageMaker Pipeline and GitHub Actions☆71Updated 9 months ago
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆172Updated last year
- Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…☆139Updated 3 weeks ago
- ☆43Updated 9 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆224Updated this week
- MLOps End-to-End Example using Amazon SageMaker Pipeline, AWS CodePipeline and AWS CDK☆138Updated last week
- ☆139Updated 10 months ago