GoogleCloudPlatform / gcs-connector-for-pytorchLinks
A direct Google Cloud Storage integration for PyTorch
☆38Updated 2 months ago
Alternatives and similar repositories for gcs-connector-for-pytorch
Users that are interested in gcs-connector-for-pytorch are comparing it to the libraries listed below
Sorting:
- ☆33Updated this week
- xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…☆123Updated this week
- The Amazon S3 Connector for PyTorch delivers high throughput for PyTorch training jobs that access and store data in Amazon S3.☆164Updated last week
- This is the git repository for the Dataflux Python client library, providing fast listing and download of small files from GCS in Python.…☆19Updated 2 weeks ago
- Testing framework for Deep Learning models (Tensorflow and PyTorch) on Google Cloud hardware accelerators (TPU and GPU)☆64Updated last week
- ☆138Updated 2 weeks ago
- Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.☆66Updated last week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆157Updated 5 months ago
- Unified storage framework for the entire machine learning lifecycle☆155Updated last year
- MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.☆157Updated 8 months ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆60Updated 2 months ago
- DL Dataloader Benchmarks☆18Updated 4 months ago
- Home for OctoML PyTorch Profiler☆113Updated 2 years ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆366Updated last week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆334Updated this week
- A top-like tool for monitoring GPUs in a cluster☆85Updated last year
- Module, Model, and Tensor Serialization/Deserialization☆234Updated this week
- Cluster Toolkit is an open-source software offered by Google Cloud which makes it easy for customers to deploy AI/ML and HPC environments…☆260Updated this week
- PyTorch per step fault tolerance (actively under development)☆302Updated last week
- TorchFix - a linter for PyTorch-using code with autofix support☆141Updated 3 months ago
- Cray-LM unified training and inference stack.☆22Updated 4 months ago
- GeoT: Tensor Centric Library for Graph Neural Network via Efficient Segment Reduction on GPU☆23Updated 2 months ago
- Lightning support for Intel Habana accelerators.☆27Updated last month
- ☆215Updated this week
- Google TPU optimizations for transformers models☆112Updated 4 months ago
- ☆58Updated last year
- Automate issue discovery for your projects against Lightning nightly and releases.☆47Updated 3 weeks ago
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆66Updated last year
- oneCCL Bindings for Pytorch*☆97Updated last month
- ☆45Updated this week