cubed-dev / cubedLinks
Scalable array processing with bounded memory
☆237Updated this week
Alternatives and similar repositories for cubed
Users that are interested in cubed are comparing it to the libraries listed below
Sorting:
- Disk-to-disk chunk transformation for chunked arrays.☆172Updated last month
- Distributed Xarray with Apache Beam☆147Updated this week
- ☆61Updated this week
- Fast & furious GroupBy operations for dask.array☆133Updated 2 weeks ago
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆224Updated this week
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆139Updated 2 weeks ago
- 🎀 Awesome Zarr resources☆92Updated last year
- 🌈😊 Enjoy animating images into GIFs and MP4s in parallel!☆63Updated last year
- A Python protocol for interfacing with object storage.☆27Updated 2 months ago
- Cloud-friendly access to archival data☆349Updated last month
- "Hacking Dask" tutorial materials☆71Updated 4 years ago
- ☆89Updated 7 months ago
- WIP implementation of a tree-like hierarchical data structure for xarray.☆167Updated 10 months ago
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated 5 months ago
- Interface for using cupy in xarray, providing convenience accessors.☆82Updated last week
- Schema validation for Xarray objects☆42Updated last month
- Pydantic models for Zarr☆38Updated this week
- Hack wrapper around zarr to make data access async☆17Updated 2 years ago
- Publish Xarray Datasets via a REST API.☆183Updated last week
- A CodecPipeline for zarr-python backed by the zarrs Rust crate☆50Updated last week
- Open-source, cloud-native transactional tensor storage engine☆490Updated this week
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆101Updated 2 months ago
- ☆60Updated 3 weeks ago
- The Pandata scalable open-source analysis stack☆68Updated last year
- Interface for using cubed with xarray☆30Updated 2 weeks ago
- Batch generation from xarray datasets☆182Updated last week
- Dask development blog☆30Updated 9 months ago
- Robustly creating and updating Zarr data cubes from smaller subsets☆45Updated 5 months ago
- Launch Jupyter Lab over SSH with a single command!☆36Updated 2 weeks ago
- xarray data creation by data classes☆80Updated 8 months ago