Alternatives and similar repositories for s3-connector-for-pytorch

Users that are interested in s3-connector-for-pytorch are comparing it to the libraries listed below

• aws / amazon-s3-plugin-for-pytorch
  ☆167Updated 2 years ago
• aws-samples / awsome-inference
  ☆47Updated last month
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆43Updated last year
• aws-samples / aws-do-eks
  Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…
  ☆59Updated 2 weeks ago
• aws-neuron / transformers-neuronx
  ☆110Updated 5 months ago
• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆347Updated 7 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆240Updated last week
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆367Updated last week
• aws-samples / aws-efa-eks
  Deploying EFA in EKS utilizing GPUDirectRDMA where supported
  ☆37Updated 8 months ago
• aws-neuron / neuronx-distributed
  ☆58Updated last month
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆230Updated this week
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆246Updated 3 months ago
• aws-samples / aws-samples-for-ray
  ☆72Updated last year
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆98Updated last week
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆149Updated 2 weeks ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆278Updated this week
• awslabs / ml-io
  A high performance data access library for machine learning tasks
  ☆74Updated last year
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆176Updated this week
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆179Updated 2 weeks ago
• awslabs / aws-virtual-gpu-device-plugin
  AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads
  ☆205Updated last year
• ppl-ai / libfabric-efa-demo
  ☆62Updated 4 months ago
• run-ai / runai-model-streamer
  ☆221Updated this week
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated this week
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆345Updated 4 months ago
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆329Updated this week
• NVIDIA / nephele
  Tools to deploy GPU clusters in the Cloud
  ☆31Updated 2 years ago
• aws-samples / aws-do-hyperpod
  Create and manage Amazon SageMaker HyperPod clusters, run distributed model training
  ☆23Updated last month
• aws-solutions-library-samples / guidance-for-machine-learning-inference-on-aws
  This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …
  ☆44Updated 3 weeks ago
• awslabs / kubeflow-manifests
  KubeFlow on AWS
  ☆184Updated 2 weeks ago
• aws-samples / awsome-distributed-training
  Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
  ☆313Updated this week