aws / sagemaker-huggingface-inference-toolkit
☆235Updated 3 weeks ago
Related projects: ⓘ
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆193Updated this week
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆134Updated 3 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆120Updated 2 weeks ago
- Zero administration inference with AWS Lambda for 🤗☆62Updated 2 years ago
- ☆94Updated this week
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆217Updated last week
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆382Updated 10 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆118Updated this week
- ☆56Updated this week
- ☆86Updated last year
- Use LLMs for building real-world apps☆107Updated 6 months ago
- Train machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆484Updated last week
- Foundation Model Evaluations Library☆184Updated 3 weeks ago
- Amazon SageMaker Local Mode Examples☆242Updated last month
- A 90-minute hands on workshop about Hugging Face on SageMaker.☆26Updated 2 years ago
- Large Language Model Hosting Container☆75Updated 2 weeks ago
- ☆48Updated last month
- This is the Docker container based on open source framework XGBoost (https://xgboost.readthedocs.io/en/latest/) to allow customers use th…☆123Updated last week
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆175Updated this week
- Deploy llama.cpp compatible Generative AI LLMs on AWS Lambda!☆165Updated 5 months ago
- ☆41Updated 4 months ago
- ☆142Updated last year
- ☆103Updated this week
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆196Updated 10 months ago
- ☆138Updated 5 months ago
- ☆362Updated last year
- A generative AI-powered framework for testing virtual agents.☆86Updated 3 weeks ago
- ☆30Updated 7 months ago
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆174Updated last year
- ☆13Updated 9 months ago