Alternatives and similar repositories for multi-storage-client

Users that are interested in multi-storage-client are comparing it to the libraries listed below

• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆349Updated 7 months ago
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆179Updated 3 weeks ago
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆351Updated 2 weeks ago
• pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆349Updated this week
• NVIDIA / aistore
  AIStore: scalable storage for AI applications
  ☆1,535Updated this week
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆422Updated last week
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆368Updated last week
• NVIDIA / nephele
  Tools to deploy GPU clusters in the Cloud
  ☆31Updated 2 years ago
• rapidsai / kvikio
  KvikIO - High Performance File IO
  ☆213Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆241Updated 2 weeks ago
• awslabs / s3-connector-for-pytorch
  The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.
  ☆166Updated this week
• google / paxml
  Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…
  ☆512Updated 2 weeks ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆97Updated this week
• google / saxml
  ☆141Updated 3 weeks ago
• DragonHPC / dragon
  Dragon distributed runtime for HPC and AI applications and workflows
  ☆72Updated this week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆202Updated this week
• ppl-ai / libfabric-efa-demo
  ☆62Updated 4 months ago
• imbue-ai / cluster-health
  ☆310Updated 10 months ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆76Updated this week
• mlcommons / training_results_v3.1
  This repository contains the results and code for the MLPerf™ Training v3.1 benchmark.
  ☆17Updated 5 months ago
• NVIDIA-NeMo / Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆162Updated this week
• run-ai / runai-model-streamer
  ☆222Updated this week
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆377Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆188Updated this week
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆176Updated this week
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆62Updated 3 months ago
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆184Updated 3 weeks ago
• triton-inference-server / triton_distributed
  ☆50Updated 3 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆204Updated this week
• pytorch-labs / monarch
  PyTorch Single Controller
  ☆231Updated this week