aws-neuron / neuronx-distributed-inference
☆13Updated 2 months ago
Alternatives and similar repositories for neuronx-distributed-inference:
Users that are interested in neuronx-distributed-inference are comparing it to the libraries listed below
- ☆38Updated last week
- Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stac…☆231Updated 2 weeks ago
- ☆87Updated this week
- ☆76Updated last week
- Mistral on AWS examples for Bedrock & SageMaker☆60Updated this week
- ☆28Updated 10 months ago
- Some crazy experiments☆33Updated last month
- ☆30Updated 5 months ago
- Example code for AWS Neuron SDK developers building inference and training applications☆140Updated last month
- ☆12Updated last year
- ☆53Updated last month
- ☆13Updated 8 months ago
- ☆60Updated last year
- ☆9Updated 11 months ago
- Repository for training and deploying Generative AI models, including text-text, text-to-image generation and prompt engineering playgrou…☆142Updated last week
- ☆23Updated last month
- ☆23Updated last week
- ☆55Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆12Updated this week
- Foundation Model Evaluations Library☆239Updated 2 weeks ago
- Pre-built examples of Generative AI agents with Bedrock across multiple industries.☆36Updated 5 months ago
- ☆20Updated last week
- ☆59Updated 9 months ago
- ☆11Updated last week
- ☆83Updated last week
- Hands-on workshop for distributed training and hosting on SageMaker☆133Updated last month
- ☆54Updated 5 months ago
- ☆11Updated last year
- ☆43Updated last month
- ☆15Updated 7 months ago