GoogleCloudPlatform / gcs-connector-for-pytorchLinks
A direct Google Cloud Storage integration for PyTorch
☆41Updated last month
Alternatives and similar repositories for gcs-connector-for-pytorch
Users that are interested in gcs-connector-for-pytorch are comparing it to the libraries listed below
Sorting:
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆394Updated this week
- Pytorch Lightning Distributed Accelerators using Ray☆214Updated last year
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated 3 weeks ago
- ☆145Updated last week
- Unified storage framework for the entire machine learning lifecycle☆155Updated last year
- DL Dataloader Benchmarks☆20Updated 8 months ago
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆88Updated 2 weeks ago
- Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)☆65Updated 3 months ago
- MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.☆157Updated last year
- The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.☆180Updated last week
- Ray-based Apache Beam runner☆41Updated 2 years ago
- ☆56Updated last week
- aim-mlflow integration☆221Updated 2 years ago
- This repository compiles prescriptive guidance and code samples for the operationalization of NVIDIA Merlin framework on Google Cloud Ver…☆34Updated 3 years ago
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆145Updated this week
- Cluster Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy AI/ML and HPC environments…☆290Updated this week
- ☆58Updated last year
- ☆84Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆379Updated 4 months ago
- High performance model preprocessing library on PyTorch☆644Updated last year
- This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic …☆102Updated this week
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆60Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆267Updated last month
- Provide Python access to the NVML library for GPU diagnostics☆248Updated last month
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Updated 3 years ago
- Lightning HPO & Training Studio App☆18Updated 2 years ago
- Torch Distributed Experimental☆117Updated last year
- ☆61Updated 2 years ago
- ☆39Updated 2 years ago