aws-neuron / neuronx-distributed-inference
☆11Updated last month
Alternatives and similar repositories for neuronx-distributed-inference:
Users that are interested in neuronx-distributed-inference are comparing it to the libraries listed below
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆225Updated this week
- ☆38Updated last week
- ☆77Updated last week
- ☆71Updated 2 weeks ago
- ☆30Updated 4 months ago
- ☆59Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆135Updated last week
- Mistral on AWS examples for Bedrock & SageMaker☆54Updated this week
- ☆82Updated this week
- Foundation Model Evaluations Library☆231Updated last week
- Some crazy experiments☆32Updated 2 weeks ago
- ☆40Updated last week
- ☆36Updated this week
- ☆20Updated 2 months ago
- ☆23Updated 2 months ago
- ☆14Updated 6 months ago
- Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…☆139Updated 3 weeks ago
- Hands-on workshop for distributed training and hosting on SageMaker☆131Updated this week
- ☆28Updated 9 months ago
- ☆52Updated 4 months ago
- ☆65Updated this week
- ☆59Updated 7 months ago
- AWS Generative AI Conversational RAG Reference (Galileo)☆73Updated last week
- ☆12Updated last year
- Pre-built examples of Generative AI agents with Bedrock across multiple industries.☆32Updated 4 months ago
- ☆51Updated last week
- This repository features three demos that can be effortlessly integrated into your AWS environment. They serve as a practical guide to le…☆39Updated 9 months ago
- Secure and scalable MLOps platform on AWS using Terraform.☆38Updated 3 months ago