cubed-dev / cubedLinks
Scalable array processing with bounded memory
☆214Updated last week
Alternatives and similar repositories for cubed
Users that are interested in cubed are comparing it to the libraries listed below
Sorting:
- Disk-to-disk chunk transformation for chunked arrays.☆171Updated 3 weeks ago
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆212Updated this week
- Distributed Xarray with Apache Beam☆147Updated 2 weeks ago
- ☆59Updated last week
- Fast & furious GroupBy operations for dask.array☆132Updated last week
- Cloud-friendly access to archival data☆345Updated this week
- Open-source, cloud-native transactional tensor storage engine☆448Updated this week
- Hack wrapper around zarr to make data access async☆17Updated 2 years ago
- 🎀 Awesome Zarr resources☆93Updated last year
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated 3 months ago
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆139Updated this week
- 🌈😊 Enjoy animating images into GIFs and MP4s in parallel!☆63Updated 11 months ago
- ☆58Updated 11 months ago
- Pydantic models for Zarr☆33Updated this week
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆96Updated 3 weeks ago
- WIP implementation of a tree-like hierarchical data structure for xarray.☆166Updated 8 months ago
- Interface for using cupy in xarray, providing convenience accessors.☆80Updated last week
- Schema validation for Xarray objects☆42Updated 3 weeks ago
- A small utility for generating ND array pyramids using Xarray and Zarr.☆105Updated last week
- ☆89Updated 5 months ago
- Batch generation from xarray datasets☆176Updated last week
- A Python protocol for interfacing with object storage.☆27Updated 2 weeks ago
- "Hacking Dask" tutorial materials☆71Updated 4 years ago
- Dask development blog☆30Updated 7 months ago
- A CodecPipeline for zarr-python backed by zarrs (Rust)☆43Updated this week
- Publish Xarray Datasets via a REST API.☆179Updated last week
- Python library for building Pangeo Forge recipes.☆133Updated last week
- Save multichannel data from xarray datasets as videos to save up massive amounts of space☆72Updated last week
- A dataset for loading zarr files to be used in machine learning training pipelines☆34Updated last month
- Tool for writing large xarray datasets to zarr stores with independent processes☆30Updated 3 months ago