Alternatives and similar repositories for multi-storage-client

Users that are interested in multi-storage-client are comparing it to the libraries listed below

• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆335Updated this week
• NVIDIA / aistore
  AIStore: scalable storage for AI applications
  ☆1,519Updated this week
• NVIDIA / pyxis
  Container plugin for Slurm Workload Manager
  ☆344Updated 7 months ago
• google / paxml
  Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…
  ☆499Updated 2 weeks ago
• ai-dynamo / nixl
  NVIDIA Inference Xfer Library (NIXL)
  ☆387Updated this week
• triton-inference-server / triton_distributed
  ☆49Updated 3 months ago
• NVIDIA / nephele
  Tools to deploy GPU clusters in the Cloud
  ☆31Updated 2 years ago
• NVIDIA / nvidia-resiliency-ext
  NVIDIA Resiliency Extension is a python package for framework developers and users to implement fault-tolerant features. It improves the …
  ☆173Updated this week
• google / saxml
  ☆138Updated 2 weeks ago
• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆302Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆75Updated this week
• rapidsai / kvikio
  KvikIO - High Performance File IO
  ☆210Updated this week
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆60Updated 2 months ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆366Updated 2 weeks ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆234Updated last week
• NVIDIA / NeMo-Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆153Updated this week
• NVIDIA / nim-deploy
  A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deploymen…
  ☆182Updated last week
• run-ai / runai-model-streamer
  ☆215Updated last week
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆105Updated last week
• aws / aws-ofi-nccl
  This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.
  ☆176Updated this week
• mlcommons / training_results_v3.1
  This repository contains the results and code for the MLPerf™ Training v3.1 benchmark.
  ☆17Updated 4 months ago
• ppl-ai / libfabric-efa-demo
  ☆62Updated 3 months ago
• NVIDIA / JAX-Toolbox
  JAX-Toolbox
  ☆308Updated this week
• NVIDIA / NeMo-Curator
  Scalable data pre processing and curation toolkit for LLMs
  ☆933Updated this week
• NVIDIA / ais-etl
  Provides for deploying custom ETL containers on AIStore, with subsequent user-defined extraction-transformation-loading in parallel, on t…
  ☆16Updated this week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆767Updated 9 months ago
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆123Updated this week
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆269Updated last week
• pytorch / tensorpipe
  A tensor-aware point-to-point communication primitive for machine learning
  ☆257Updated 2 years ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆186Updated this week