JackKelly / light-speed-io

Related projects ⓘ

Alternatives and complementary repositories for light-speed-io

• LDeakin / zarrs
  A rust library for the Zarr storage format for multidimensional arrays and metadata
  ☆109Updated last week
• sci-rs / zarr
  Rust implementation of the Zarr N-dimensional array format.
  ☆52Updated 8 months ago
• martindurant / rfsspec
  Rust python FS
  ☆32Updated last year
• kylebarron / arro3
  A minimal Python library for Apache Arrow, connecting to the Rust arrow crate
  ☆103Updated this week
• alimanfoo / zarrita
  ☆16Updated 2 years ago
• JackKelly / hypergrib
  Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray
  ☆26Updated this week
• cubed-dev / cubed
  Bounded-memory serverless distributed N-dimensional array processing
  ☆122Updated this week
• zarr-developers / zarr-specs
  Zarr core protocol for storage and retrieval of N-dimensional typed arrays
  ☆88Updated last month
• clbarnes / zarr3-rs
  Prototype implementation of zarr v3 in rust
  ☆18Updated last year
• gauteh / hidefix
  🐕 Concurrent HDF5 and NetCDF4 reader
  ☆52Updated last month
• datafusion-contrib / arrow-zarr
  Implementation of Zarr file format in Rust
  ☆10Updated 2 weeks ago
• janelia-cellmap / pydantic-zarr
  Pydantic models for Zarr
  ☆26Updated 7 months ago
• zarr-developers / zeps
  Zarr Enhancement Proposals
  ☆12Updated 4 months ago
• roeap / object-store-python
  Python bindings and arrow integration for the rust object_store crate.
  ☆57Updated 3 months ago
• google / xarray-tensorstore
  ☆50Updated 2 weeks ago
• scalableminds / zarrita
  ☆19Updated last month
• mainmatter / rust-python-interoperability
  A self-paced course to write Python extensions in Rust, one exercise at a time.
  ☆39Updated 3 weeks ago
• asomers / blosc-rs
  Rust bindings for C-Blosc
  ☆17Updated last month
• coiled / benchmarks
  ☆34Updated this week
• LDeakin / zarrs_tools
  Various tools for creating and manipulating Zarr v3 data with the zarrs rust crate
  ☆17Updated this week
• developmentseed / obstore
  Simple, fast integration with Amazon S3, Google Cloud Storage, Azure Storage, and S3-compliant APIs like Cloudflare R2
  ☆146Updated this week
• martindurant / async-zarr
  Hack wrapper around zarr to make data access async
  ☆17Updated last year
• mpiannucci / gribberish
  Read GRIB files with Rust
  ☆50Updated last month
• xtensor-stack / xtensor-zarr
  Implementation of the Zarr core protocol (version 2 and 3) based on xtensor.
  ☆39Updated 2 years ago
• alimanfoo / numpydoc_decorator
  Build numpy-style docstrings programmatically and apply them using a decorator.
  ☆16Updated 2 months ago
• phayes / polars_gdal
  Read GDAL compatible file formats into polars / geopolars
  ☆21Updated last year
• joshuarobinson / python_fasts3
  Fast S3 in Python using Rust
  ☆44Updated 2 years ago
• nmandery / py_geo_interface
  Exchange vector geometries between Rust and Python using pyo3 and Pythons __geo_interface__ protocol
  ☆21Updated last month
• cubed-dev / cubed-xarray
  Interface for using cubed with xarray
  ☆26Updated 2 weeks ago
• spencerkclark / xpartition
  Tool for writing large xarray datasets to zarr stores with independent processes
  ☆28Updated 3 months ago