Alternatives and similar repositories for s3-connector-for-pytorch:

Users that are interested in s3-connector-for-pytorch are comparing it to the libraries listed below

• aws-neuron / transformers-neuronx
  ☆107Updated 3 months ago
• aws-neuron / neuronx-distributed
  ☆55Updated last month
• aws / amazon-s3-plugin-for-pytorch
  ☆167Updated 2 years ago
• aws-samples / awsome-inference
  ☆46Updated last week
• aws-samples / aws-efa-nccl-baseami-pipeline
  EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers
  ☆43Updated last year
• aws-neuron / aws-neuron-samples
  Example code for AWS Neuron SDK developers building inference and training applications
  ☆143Updated last week
• ppl-ai / libfabric-efa-demo
  ☆58Updated 2 months ago
• aws-samples / aws-do-eks
  Create, List, Update, Delete Amazon EKS clusters. Deploy and manage software on EKS. Run distributed model training and inference example…
  ☆58Updated last week
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆361Updated this week
• huggingface / optimum-neuron
  Easy, fast and very cheap training and inference on AWS Trainium and Inferentia chips.
  ☆229Updated this week
• aws-neuron / upstreaming-to-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆15Updated this week
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆252Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆225Updated 2 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆149Updated this week
• aws-neuron / aws-neuron-eks-samples
  ☆24Updated 3 months ago
• awslabs / ml-io
  A high performance data access library for machine learning tasks
  ☆74Updated last year
• aws-samples / aws-samples-for-ray
  ☆70Updated 10 months ago
• aws-samples / sagemaker-ssh-helper
  A helper library to connect into Amazon SageMaker with AWS Systems Manager and SSH (Secure Shell)
  ☆241Updated 2 months ago
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆293Updated this week
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆94Updated this week
• aws-samples / awsome-distributed-training
  Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.
  ☆285Updated this week
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆169Updated last week
• NVIDIA / nephele
  Tools to deploy GPU clusters in the Cloud
  ☆31Updated 2 years ago
• amzn / amazon-ray
  Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.
  ☆66Updated last year
• aws-solutions-library-samples / guidance-for-machine-learning-inference-on-aws
  This Guidance demonstrates how to deploy a machine learning inference architecture on Amazon Elastic Kubernetes Service (Amazon EKS). It …
  ☆42Updated 3 months ago
• run-ai / runai-model-streamer
  ☆207Updated this week
• aws-neuron / aws-neuron-parallelcluster-samples
  ☆24Updated last year
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆151Updated last week
• aws-neuron / aws-neuron-sdk
  Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…
  ☆510Updated 2 weeks ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆330Updated 3 months ago