cubed-dev / cubed
Scalable array processing with bounded memory
☆193Updated last month
Alternatives and similar repositories for cubed:
Users that are interested in cubed are comparing it to the libraries listed below
- Disk-to-disk chunk transformation for chunked arrays.☆170Updated last week
- Distributed Xarray with Apache Beam☆147Updated last week
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆188Updated this week
- Fast & furious GroupBy operations for dask.array☆130Updated last week
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated last month
- Cloud-friendly access to archival data☆332Updated 2 weeks ago
- ☆57Updated 6 months ago
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆138Updated this week
- ☆89Updated 3 months ago
- Batch generation from xarray datasets☆174Updated 3 weeks ago
- Publish Xarray Datasets via a REST API.☆174Updated this week
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆93Updated 3 weeks ago
- Interface for using cupy in xarray, providing convenience accessors.☆77Updated last week
- "Hacking Dask" tutorial materials☆71Updated 3 years ago
- ☆34Updated 2 weeks ago
- A Rust library for the Zarr storage format for multidimensional arrays and metadata☆141Updated this week
- WIP implementation of a tree-like hierarchical data structure for xarray.☆165Updated 6 months ago
- ☆55Updated 9 months ago
- Hack wrapper around zarr to make data access async☆17Updated 2 years ago
- Docker Images For Pangeo Jupyter Environment☆134Updated last month
- Read & decompress many chunks of files at high speed☆63Updated this week
- 🎀 Awesome Zarr resources☆87Updated 10 months ago
- A small utility for generating ND array pyramids using Xarray and Zarr.☆102Updated last month
- Open-source, cloud-native transactional tensor storage engine☆412Updated this week
- Pydantic models for Zarr☆32Updated last month
- Zarr Enhancement Proposals☆14Updated 2 months ago
- Python library for building Pangeo Forge recipes.☆131Updated this week
- Lexcube: 3D Data Cube Visualization in Jupyter Notebooks☆148Updated this week
- Implementation of the Zarr core protocol (version 2 and 3) based on xtensor.☆45Updated 2 years ago
- 📦 Pack and unpack conda environments created with pixi☆113Updated this week