huggingface / optimum-neuron
Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
☆218Updated this week
Alternatives and similar repositories for optimum-neuron:
Users that are interested in optimum-neuron are comparing it to the libraries listed below
- ☆102Updated last month
- Example code for AWS Neuron SDK developers building inference and training applications☆135Updated last week
- Large Language Model Hosting Container☆83Updated last week
- ☆51Updated last week
- ☆245Updated 4 months ago
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆136Updated 4 months ago
- ☆61Updated 2 weeks ago
- A generative AI-powered framework for testing virtual agents.☆170Updated last month
- experiments with inference on llama☆104Updated 8 months ago
- ☆39Updated last week
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆231Updated 2 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆224Updated this week
- ☆34Updated 2 months ago
- Hands-on workshop for distributed training and hosting on SageMaker☆131Updated 2 weeks ago
- Foundation Model Evaluations Library☆230Updated last week
- ☆40Updated 3 months ago
- ☆77Updated this week
- ☆23Updated 10 months ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆252Updated 7 months ago
- ☆51Updated 2 months ago
- A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…☆157Updated last week
- ☆88Updated last year
- ☆66Updated 7 months ago
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆244Updated this week
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆286Updated 2 weeks ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆492Updated last week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆190Updated this week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆170Updated this week
- Google TPU optimizations for transformers models☆98Updated 3 weeks ago