cubed-dev / cubedLinks
Scalable array processing with bounded memory
☆201Updated this week
Alternatives and similar repositories for cubed
Users that are interested in cubed are comparing it to the libraries listed below
Sorting:
- Distributed Xarray with Apache Beam☆147Updated last month
- Disk-to-disk chunk transformation for chunked arrays.☆171Updated 3 weeks ago
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated 2 months ago
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆201Updated this week
- ☆59Updated 7 months ago
- Fast & furious GroupBy operations for dask.array☆132Updated last week
- 🎀 Awesome Zarr resources☆91Updated last year
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆139Updated last week
- ☆89Updated 5 months ago
- Cloud-friendly access to archival data☆341Updated last month
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆94Updated this week
- Batch generation from xarray datasets☆176Updated 2 months ago
- ☆56Updated 10 months ago
- Publish Xarray Datasets via a REST API.☆179Updated 2 weeks ago
- Open-source, cloud-native transactional tensor storage engine☆437Updated this week
- Interface for using cupy in xarray, providing convenience accessors.☆80Updated last month
- A zarrs-backed CodecPipeline for zarr-python☆36Updated last month
- Pydantic models for Zarr☆32Updated 2 weeks ago
- A Rust library for the Zarr storage format for multidimensional arrays and metadata☆150Updated this week
- WIP implementation of a tree-like hierarchical data structure for xarray.☆166Updated 8 months ago
- A small utility for generating ND array pyramids using Xarray and Zarr.☆102Updated 2 months ago
- 📦 Pack and unpack conda environments created with pixi☆117Updated 2 weeks ago
- Implementation of the Zarr core protocol (version 2 and 3) based on xtensor.☆45Updated 3 years ago
- 🌈😊 Enjoy animating images into GIFs and MP4s in parallel!☆62Updated 10 months ago
- Schema validation for Xarray objects☆42Updated 2 months ago
- A dataset for loading zarr files to be used in machine learning training pipelines☆33Updated 3 weeks ago
- Lexcube: 3D Data Cube Visualization in Jupyter Notebooks☆154Updated last week
- Zarr Enhancement Proposals☆14Updated 4 months ago
- An experiment to query Xarray datasets with SQL☆34Updated 10 months ago
- Robustly creating and updating Zarr data cubes from smaller subsets☆45Updated 2 months ago