JackKelly / light-speed-io
Read & decompress many chunks of files at high speed
☆62Updated 5 months ago
Alternatives and similar repositories for light-speed-io:
Users that are interested in light-speed-io are comparing it to the libraries listed below
- Rust implementation of the Zarr N-dimensional array format.☆54Updated last year
- A Rust library for the Zarr storage format for multidimensional arrays and metadata☆134Updated this week
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆43Updated last month
- Rust python FS☆33Updated last year
- A minimal Python library for Apache Arrow, connecting to the Rust arrow crate☆137Updated this week
- 🐕 Concurrent HDF5 and NetCDF4 reader☆55Updated 5 months ago
- Various tools for creating and manipulating Zarr V3 data with the zarrs rust crate☆19Updated last week
- Scalable array processing with bounded memory☆149Updated this week
- Rust bindings for C-Blosc☆18Updated 5 months ago
- Implementation of Zarr file format in Rust☆11Updated 2 weeks ago
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆93Updated last month
- An experimental (work-in-progress) statically typed implementation of Apache Arrow☆18Updated this week
- Prototype implementation of zarr v3 in rust☆18Updated last year
- ☆31Updated last week
- Python bindings and arrow integration for the rust object_store crate.☆63Updated 7 months ago
- A Rust crate and Python library for packed, immutable, zero-copy spatial indexes.☆148Updated 3 weeks ago
- The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.☆269Updated this week
- ☆89Updated 2 months ago
- Python library allowing to manipulate data split into a collection of groups stored in Zarr format.☆12Updated last week
- ☆17Updated 2 years ago
- ☆57Updated 4 months ago
- ☆37Updated this week
- Async TIFF reader for Rust and Python☆41Updated this week
- Zarr Enhancement Proposals☆14Updated last month
- High-level netCDF bindings for Rust☆87Updated last month
- Is the GIL seeing someone else? How's about repetitively calling and seeing how long it takes to answer?☆14Updated 5 months ago
- Pydantic models for Zarr☆30Updated 3 weeks ago
- Cloud-optimized GeoTIFF ... Parallel I/O 🦀☆38Updated this week
- Arrow, pydantic style☆82Updated 2 years ago
- Read GRIB files with Rust☆55Updated 2 months ago