awslabs / s3-connector-for-pytorchLinks
The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.
☆168Updated last week
Alternatives and similar repositories for s3-connector-for-pytorch
Users that are interested in s3-connector-for-pytorch are comparing it to the libraries listed below
Sorting:
- ☆167Updated 2 years ago
- ☆111Updated 6 months ago
- ☆48Updated this week
- Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.☆233Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆248Updated this week
- Container plugin for Slurm Workload Manager☆354Updated 8 months ago
- Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…☆60Updated last month
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆370Updated last week
- ☆59Updated 2 weeks ago
- Infrastructure as code for GPU accelerated managed Kubernetes clusters.☆54Updated 2 months ago
- EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers☆43Updated last year
- Example code for AWS Neuron SDK developers building inference and training applications☆148Updated last month
- Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.☆323Updated this week
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆529Updated this week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆102Updated last week
- ☆228Updated this week
- A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)☆247Updated last week
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆205Updated last year
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- KubeFlow on AWS☆184Updated last month
- ☆72Updated last year
- Deploying EFA in EKS utilizing GPUDirectRDMA where supported☆37Updated 9 months ago
- CUDA checkpoint and restore utility☆346Updated 5 months ago
- A tool to configure, launch and manage your machine learning experiments.☆171Updated this week
- Scalable and Performant Data Loading☆288Updated last week
- The Triton backend for the PyTorch TorchScript models.☆154Updated 2 weeks ago
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆129Updated this week
- Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.☆66Updated last year
- Repository for open inference protocol specification☆57Updated 2 months ago
- Controller for ModelMesh☆234Updated last month