cubed-dev / cubed
Scalable array processing with bounded memory
☆153Updated 2 weeks ago
Alternatives and similar repositories for cubed:
Users that are interested in cubed are comparing it to the libraries listed below
- Disk-to-disk chunk transformation for chunked arrays.☆169Updated last week
- Fast & furious GroupBy operations for dask.array☆130Updated this week
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆177Updated this week
- A small utility for generating ND array pyramids using Xarray and Zarr.☆102Updated last week
- Publish Xarray Datasets via a REST API.☆172Updated last week
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆93Updated 3 weeks ago
- Interface for using cupy in xarray, providing convenience accessors.☆76Updated this week
- WIP implementation of a tree-like hierarchical data structure for xarray.☆165Updated 5 months ago
- 🎀 Awesome Zarr resources☆86Updated 10 months ago
- ☆57Updated 5 months ago
- Distributed Xarray with Apache Beam☆147Updated last month
- Cloud-friendly access to archival data☆328Updated 2 weeks ago
- ☆33Updated this week
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆44Updated 2 weeks ago
- Python library for building Pangeo Forge recipes.☆131Updated last week
- Pydantic models for Zarr☆31Updated last week
- ☆53Updated 8 months ago
- Robustly creating and updating Zarr data cubes from smaller subsets☆43Updated 3 months ago
- Batch generation from xarray datasets☆172Updated last week
- Build numpy-style docstrings programmatically and apply them using a decorator.☆16Updated 7 months ago
- Launch Jupyter Lab over SSH with a single command!☆35Updated last week
- Tool for writing large xarray datasets to zarr stores with independent processes☆28Updated this week
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆136Updated this week
- An adapter to convert NetCDF files to TileDB arrays☆31Updated 3 years ago
- Hack wrapper around zarr to make data access async☆17Updated 2 years ago
- Intake plugin for xarray☆78Updated 4 months ago
- Schema validation for Xarray objects☆42Updated 2 weeks ago
- Open-source, cloud-native transactional tensor storage engine☆393Updated this week
- Interface for using pint with xarray, providing convenience accessors☆109Updated 2 weeks ago
- Implementation of the Zarr core protocol (version 2 and 3) based on xtensor.☆43Updated 2 years ago