aws-neuron / neuronx-distributedLinks
☆64Updated last month
Alternatives and similar repositories for neuronx-distributed
Users that are interested in neuronx-distributed are comparing it to the libraries listed below
Sorting:
- ☆58Updated last week
- ☆111Updated last year
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆578Updated last week
- Example code for AWS Neuron SDK developers building inference and training applications☆157Updated 3 weeks ago
- ☆39Updated last year
- Training and inference on AWS Trainium and Inferentia chips.☆258Updated last week
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆386Updated last week
- ☆23Updated 2 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆219Updated this week
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆170Updated 3 weeks ago
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆43Updated 2 years ago
- ☆17Updated this week
- ☆57Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆24Updated 3 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆255Updated this week
- Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors☆165Updated last year
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆164Updated 3 weeks ago
- Applied AI experiments and examples for PyTorch☆315Updated 5 months ago
- Distributed preprocessing and data loading for language datasets☆40Updated last year
- ☆14Updated last month
- ☆15Updated 4 years ago
- ☆252Updated last year
- Project showing how to develop NKI kernels for Llama 3.2 1B inference☆20Updated 8 months ago
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆203Updated last week
- Pipeline Parallelism for PyTorch☆784Updated last year
- A library to analyze PyTorch traces.☆462Updated this week
- Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.☆158Updated 2 weeks ago
- A high performance data access library for machine learning tasks☆74Updated 2 years ago
- ☆286Updated this week
- ☆71Updated 11 months ago