GoogleCloudPlatform / gcs-connector-for-pytorch
A direct Google Cloud Storage integration for PyTorch
☆37Updated last month
Alternatives and similar repositories for gcs-connector-for-pytorch:
Users that are interested in gcs-connector-for-pytorch are comparing it to the libraries listed below
- The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.☆154Updated this week
- ☆138Updated last week
- Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)☆64Updated 5 months ago
- ☆26Updated this week
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆61Updated 2 weeks ago
- Unified storage framework for the entire machine learning lifecycle☆156Updated last year
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆67Updated last year
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆157Updated 5 months ago
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆120Updated this week
- DL Dataloader Benchmarks☆18Updated 3 months ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆322Updated this week
- Distributed ML Optimizer☆32Updated 3 years ago
- Ray-based Apache Beam runner☆42Updated last year
- PyTorch per step fault tolerance (actively under development)☆293Updated this week
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆361Updated this week
- Lightning HPO & Training Studio App☆18Updated 2 years ago
- ☆167Updated 2 years ago
- A top-like tool for monitoring GPUs in a cluster☆86Updated last year
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆60Updated last month
- Pytorch Lightning Distributed Accelerators using Ray☆210Updated last year
- This repository compiles prescriptive guidance and code samples for the operationalization of NVIDIA Merlin framework on Google Cloud Ver…☆34Updated 2 years ago
- ☆36Updated last year
- Common Python utilities and GitHub Actions in Lightning Ecosystem☆56Updated this week
- This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic …☆92Updated this week
- Fine-tuning LLMs on Flyte and Union Cloud☆28Updated last year
- ☆207Updated this week
- Functional deep learning☆108Updated 2 years ago
- Experiment management with Hydra and MLflow☆13Updated 4 years ago
- ☆21Updated 2 months ago
- ☆24Updated 2 years ago