Example workflows for executing multi-node, multi-GPU machine learning training using PyTorch on NCAR's HPC Supercomputer (Derecho).
☆16May 6, 2026Updated 2 months ago
Alternatives and similar repositories for distributed-pytorch-hpc
Users that are interested in distributed-pytorch-hpc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A collaborative benchmarking and optimization effort from NSF-NCAR, Development Seed, and NVIDIA to accelerate data-intensive geoscience …☆19Sep 1, 2025Updated 10 months ago
- GOES-16 Convective Initiation Benchmark☆18Jun 29, 2022Updated 4 years ago
- NCAR/CISL Dask Tutorial (Spring 2023)☆28Apr 15, 2026Updated 3 months ago
- Plotting and stuff of Chicago CMAQ/WRF/satellite stuff etc☆13Nov 30, 2021Updated 4 years ago
- ☆27Aug 27, 2025Updated 10 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- NCAR MILES Community Research Earth Digital Intelligence Twin (CREDIT): research platform for ML Earth system prediction models.☆88Updated this week
- Helping people avoid mistakes when producing and using datacubes☆17Jun 29, 2026Updated 3 weeks ago
- HPC helper for distributed training.☆17Aug 18, 2025Updated 11 months ago
- Performance benchmarks of Zarr V3 implementations☆20Feb 8, 2026Updated 5 months ago
- The AI Streamliner Project☆24Sep 11, 2025Updated 10 months ago
- A Python protocol for interfacing with object storage.☆33Jun 29, 2026Updated 3 weeks ago
- Code for calculating various fire indices for a research project about simultaneous large fires☆17Sep 19, 2024Updated last year
- ☆19Nov 12, 2025Updated 8 months ago
- Zarr, Icechunk, & Xarray for cloud-native geospatial data-cube analysis☆19May 6, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- MVP for opening xarray datasets from cloud zarr stores in a single thread with asyncio loops☆23Aug 6, 2023Updated 2 years ago
- The Harmonized Emissions Component (HEMCO), developed by the GEOS-Chem Support Team.☆25Updated this week
- CTSM Tutorial Materials☆38May 13, 2025Updated last year
- ☆19Jul 13, 2026Updated last week
- Earth Computer Hyperparameter Optimization☆21Jun 30, 2026Updated 3 weeks ago
- Workflow system for coupled data assimilation applications☆18Updated this week
- Mastering Geospatial Visualizations with GMT/PyGMT pre-conference workshop at AGU24☆24Jun 23, 2026Updated 3 weeks ago
- Dynamic tiles from CMR queries☆25Jul 2, 2026Updated 2 weeks ago
- ☆12Jun 19, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- NOTE: this book is no longer maintained. Please go to 'Cloud-native geospatial data cube workflows,' linked below, instead.☆17Mar 31, 2025Updated last year
- Biomass modeling and mapping of forest biomass in the boreal using NASA's ICESat-2☆18Jun 10, 2026Updated last month
- Machine learning models for estimating aleatoric and epistemic uncertainty with evidential and ensemble methods.☆30Jul 9, 2025Updated last year
- ☆12Aug 23, 2025Updated 10 months ago
- GPU accelerated utilities for data on HEALPix grids☆28Apr 4, 2026Updated 3 months ago
- Modular Physics-ML Components in JAX☆15Updated this week
- Scripts for controlling DA workflows with MPAS-Model and mpas-bundle☆25Updated this week
- Tools for scalable, repoducible access to Open Polar Radar data in the Python data ecosystem☆20Apr 29, 2026Updated 2 months ago
- Enabling random read access for deflate-compressed files☆19Aug 5, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- High-level combined tracebacks☆15May 25, 2026Updated last month
- Helping Python developers understand the structure and 'cloud-friendliness' of an HDF5 file.☆19Nov 8, 2023Updated 2 years ago
- This repository contains the code for CHEEREIO, which supports data assimilation and emissions inversions for arbitrary runs of the GEOS-…☆21Updated this week
- Top 5 papers in AI every week☆17Dec 22, 2023Updated 2 years ago
- Python client for ITSLIVE glacier ice velocities.☆22May 11, 2026Updated 2 months ago
- SPERR is a lossy scientific (floating-point) data compressor that produces one of the best rate-distortion curves.☆26Jun 12, 2026Updated last month
- Determine appropriate chunk sizes for a given xarray dataset based on target chunk size and 'chunk aspect ratio'☆15Apr 16, 2024Updated 2 years ago