huggingface / optimum-neuronLinks
Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
☆227Updated this week
Alternatives and similar repositories for optimum-neuron
Users that are interested in optimum-neuron are comparing it to the libraries listed below
Sorting:
- Example code for AWS Neuron SDK developers building inference and training applications☆145Updated 2 weeks ago
- ☆108Updated 4 months ago
- Large Language Model Hosting Container☆89Updated this week
- ☆57Updated 2 weeks ago
- ☆62Updated last month
- ☆262Updated last month
- Toolkit for allowing inference and serving with PyTorch on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at h…☆141Updated 7 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated this week
- ☆198Updated last year
- Hands-on workshop for distributed training and hosting on SageMaker☆139Updated this week
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆515Updated this week
- experiments with inference on llama☆104Updated 11 months ago
- ☆47Updated last month
- ☆72Updated 11 months ago
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆246Updated 3 months ago
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆241Updated last month
- A generative AI-powered framework for testing virtual agents.☆239Updated 2 months ago
- ☆88Updated last year
- ☆24Updated last year
- Google TPU optimizations for transformers models☆112Updated 4 months ago
- ☆24Updated 4 months ago
- ☆44Updated 7 months ago
- The package used to build the documentation of our Hugging Face repos☆114Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆234Updated this week
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆300Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆334Updated this week
- The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.☆164Updated this week
- Code for the paper "Rethinking Benchmark and Contamination for Language Models with Rephrased Samples"☆302Updated last year
- git extension for {collaborative, communal, continual} model development☆212Updated 6 months ago
- A tool to configure, launch and manage your machine learning experiments.☆153Updated this week