cubed-dev / cubedLinks
Scalable array processing with bounded memory
☆255Updated last week
Alternatives and similar repositories for cubed
Users that are interested in cubed are comparing it to the libraries listed below
Sorting:
- Disk-to-disk chunk transformation for chunked arrays.☆176Updated this week
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆260Updated this week
- ☆64Updated 3 months ago
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆141Updated this week
- Fast & furious GroupBy operations for dask.array☆132Updated this week
- Distributed Xarray with Apache Beam☆165Updated 3 weeks ago
- ☆89Updated last year
- Cloud-friendly access to archival data☆359Updated 2 weeks ago
- 🌈😊 Enjoy animating images into GIFs and MP4s in parallel!☆62Updated last month
- Open-source, cloud-native transactional tensor storage engine☆588Updated this week
- "Hacking Dask" tutorial materials☆72Updated 4 years ago
- 🎀 Awesome Zarr resources☆93Updated last year
- Pydantic models for Zarr☆46Updated 3 weeks ago
- A CodecPipeline for zarr-python backed by the zarrs Rust crate☆60Updated this week
- Hack wrapper around zarr to make data access async☆17Updated 3 years ago
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆46Updated 10 months ago
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆103Updated 4 months ago
- A Python protocol for interfacing with object storage.☆28Updated last week
- WIP implementation of a tree-like hierarchical data structure for xarray.☆164Updated last year
- Interface for using cupy in xarray, providing convenience accessors.☆85Updated last month
- Schema validation for Xarray objects☆44Updated 2 weeks ago
- ☆64Updated 5 months ago
- xarray data creation by data classes☆80Updated last year
- Save multichannel data from xarray datasets as videos to save up massive amounts of space☆96Updated 7 months ago
- This repository contains the specifications for Zarr extensions for Zarr version 3.☆13Updated 2 months ago
- A dataset for loading zarr files to be used in machine learning training pipelines☆34Updated last month
- The Pandata scalable open-source analysis stack☆69Updated last year
- Publish Xarray Datasets via a REST API.☆196Updated this week
- Performance benchmarks of Zarr V3 implementations☆17Updated last month
- Interface for using cubed with xarray☆31Updated 2 weeks ago