LDeakin / zarrs
A Rust library for the Zarr storage format for multidimensional arrays and metadata
☆130Updated this week
Alternatives and similar repositories for zarrs:
Users that are interested in zarrs are comparing it to the libraries listed below
- Rust implementation of the Zarr N-dimensional array format.☆54Updated 11 months ago
- Various tools for creating and manipulating Zarr V3 data with the zarrs rust crate☆19Updated last week
- Read & decompress many chunks of files at high speed☆61Updated 4 months ago
- Rust implementation of the N5 "Not HDF5" tensor file system format☆15Updated 2 years ago
- 📦 Pack and unpack conda environments created with pixi☆94Updated this week
- ☆27Updated this week
- 🐕 Concurrent HDF5 and NetCDF4 reader☆53Updated 4 months ago
- Prototype implementation of zarr v3 in rust☆18Updated last year
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆91Updated this week
- Scalable array processing with bounded memory☆147Updated this week
- Pydantic models for Zarr☆29Updated 3 weeks ago
- ☆19Updated 4 months ago
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆43Updated 3 weeks ago
- Build numpy-style docstrings programmatically and apply them using a decorator.☆16Updated 5 months ago
- ☆17Updated 2 years ago
- A minimal Python library for Apache Arrow, connecting to the Rust arrow crate☆120Updated last week
- Rust python FS☆33Updated last year
- Schema validation for Xarray objects☆41Updated this week
- GitHub Action to set up pixi 📦☆55Updated last week
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆132Updated this week
- A dataset for loading zarr files to be used in machine learning training pipelines☆27Updated 5 months ago
- Zarr Enhancement Proposals☆13Updated this week
- ☆57Updated 3 months ago
- Implementation of the Zarr core protocol (version 2 and 3) based on xtensor.☆41Updated 2 years ago
- High-level netCDF bindings for Rust☆87Updated this week
- A low-impact profiler to figure out how much memory each task in Dask is using☆24Updated last year
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆150Updated this week
- Open-source, cloud-native transactional tensor storage engine☆349Updated this week
- Disk-to-disk chunk transformation for chunked arrays.☆166Updated this week
- Fast & furious GroupBy operations for dask.array☆128Updated this week