awslabs / s3-connector-for-pytorchLinks
The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.
☆165Updated this week
Alternatives and similar repositories for s3-connector-for-pytorch
Users that are interested in s3-connector-for-pytorch are comparing it to the libraries listed below
Sorting:
- ☆167Updated 2 years ago
- ☆57Updated 2 weeks ago
- ☆47Updated last month
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆59Updated last week
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆227Updated last week
- ☆108Updated 4 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆366Updated 2 weeks ago
- Example code for AWS Neuron SDK developers building inference and training applications☆146Updated this week
- ☆62Updated 3 months ago
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆43Updated last year
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆300Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆234Updated this week
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆246Updated 3 months ago
- NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …☆169Updated last week
- A high performance data access library for machine learning tasks☆74Updated last year
- Deploying EFA in EKS utilizing GPUDirectRDMA where supported☆37Updated 7 months ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆518Updated this week
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆173Updated this week
- This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …☆43Updated last week
- The Triton backend for the PyTorch TorchScript models.☆150Updated 3 weeks ago
- Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.☆66Updated last year
- ☆24Updated last year
- Scalable and Performant Data Loading☆269Updated this week
- ☆24Updated this week
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆54Updated last month
- ☆72Updated 11 months ago
- Create and manage Amazon SageMaker HyperPod clusters, run distributed model training☆21Updated 2 weeks ago
- PyTorch per step fault tolerance (actively under development)☆302Updated this week
- ☆215Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated last week