Alternatives and similar repositories for s3-connector-for-pytorch

Users that are interested in s3-connector-for-pytorch are comparing it to the libraries listed below

• meta-pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆392Updated this week
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆44Updated 2 years ago
• aws-neuron / transformers-neuronx
  ☆111Updated 8 months ago
• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆414Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆268Updated last month
• run-ai / runai-model-streamer
  ☆255Updated this week
• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆385Updated this week
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆304Updated 2 weeks ago
• aws-neuron / neuronx-distributed
  ☆60Updated last week
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆242Updated last week
• aws-neuron / aws-neuron-sdk
  Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…
  ☆545Updated last week
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆110Updated this week
• aws-samples / awsome-distributed-training
  Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
  ☆351Updated last week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆149Updated this week
• aws-samples / aws-efa-eks
  Deploying EFA in EKS utilizing GPUDirectRDMA where supported
  ☆36Updated 11 months ago
• aws-samples / awsome-inference
  ☆55Updated 2 weeks ago
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆223Updated last week
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆373Updated 2 weeks ago
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆186Updated last week
• aws-samples / aws-samples-for-ray
  ☆73Updated last year
• perplexityai / libfabric-efa-demo
  ☆70Updated 7 months ago
• aws-solutions-library-samples / guidance-for-machine-learning-inference-on-aws
  This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …
  ☆46Updated 4 months ago
• aws / sagemaker-hyperpod-recipes
  ☆70Updated last week
• amzn / amazon-ray
  Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.
  ☆66Updated last year
• NVIDIA-NeMo / Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆195Updated this week
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆254Updated 2 months ago
• NVIDIA / nephele
  Tools to deploy GPU clusters in the Cloud
  ☆33Updated 2 years ago
• NVIDIA / nvidia-terraform-modules
  Infrastructure as code for GPU accelerated managed Kubernetes clusters.
  ☆55Updated 5 months ago
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆143Updated this week
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆59Updated 4 months ago