huggingface / optimum-neuronLinks
Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
☆235Updated this week
Alternatives and similar repositories for optimum-neuron
Users that are interested in optimum-neuron are comparing it to the libraries listed below
Sorting:
- ☆112Updated 6 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆148Updated this week
- ☆264Updated 3 months ago
- Large Language Model Hosting Container☆89Updated last week
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆141Updated 9 months ago
- ☆60Updated last month
- ☆62Updated 3 months ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆533Updated this week
- experiments with inference on llama☆104Updated last year
- Google TPU optimizations for transformers models☆117Updated 6 months ago
- ☆199Updated last year
- ☆44Updated 9 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆144Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆364Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆19Updated this week
- A tool to configure, launch and manage your machine learning experiments.☆174Updated this week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆191Updated this week
- ☆124Updated 9 months ago
- The package used to build the documentation of our Hugging Face repos☆122Updated this week
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆307Updated 2 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆268Updated last year
- ☆56Updated last month
- ☆171Updated 5 months ago
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆249Updated 3 weeks ago
- Module, Model, and Tensor Serialization/Deserialization☆250Updated this week
- ☆72Updated last year
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆331Updated this week
- Let's build better datasets, together!☆260Updated 7 months ago
- Amazon SageMaker Managed Spot Training Examples☆51Updated last year
- ☆19Updated 2 years ago