JackKelly / light-speed-ioLinks
Read & decompress many chunks of files at high speed
☆63Updated 3 weeks ago
Alternatives and similar repositories for light-speed-io
Users that are interested in light-speed-io are comparing it to the libraries listed below
Sorting:
- A Rust library for the Zarr storage format for multidimensional arrays and metadata☆147Updated this week
- Rust implementation of the Zarr N-dimensional array format.☆54Updated last year
- Various tools for creating and manipulating Zarr V3 data with the zarrs Rust crate☆22Updated this week
- Prototype implementation of zarr v3 in rust☆18Updated last year
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated 2 months ago
- A minimal Python library for Apache Arrow, connecting to the Rust arrow crate☆149Updated this week
- Rust python FS☆33Updated 2 years ago
- Rust bindings for C-Blosc☆19Updated last month
- 🐕 Concurrent HDF5 and NetCDF4 reader☆56Updated 7 months ago
- ALP floating point compression in Rust☆33Updated last month
- An experimental (work-in-progress) statically typed implementation of Apache Arrow☆19Updated last week
- A reader that buffers ranged calls☆12Updated 3 years ago
- A Rust crate and Python library for packed, immutable, zero-copy spatial indexes.☆159Updated 3 months ago
- A zarrs-backed CodecPipeline for zarr-python☆35Updated last week
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆93Updated this week
- Rust implementation of the FastLanes compression library☆106Updated 2 weeks ago
- Cloud-optimized GeoTIFF ... Parallel I/O 🦀☆38Updated last week
- Implementation of Zarr file format in Rust☆13Updated this week
- 📦 Pack and unpack conda environments created with pixi☆116Updated this week
- Building block library for using Apache Arrow in Rust WebAssembly modules.☆24Updated last week
- Zarr Enhancement Proposals☆14Updated 3 months ago
- Read GRIB files with Rust☆55Updated 5 months ago
- Rust implementation/translation of LAZ (Laszip) compression☆36Updated last week
- Apache Arrow database client for many databases.☆42Updated this week
- A self-paced course to write Python extensions in Rust, one exercise at a time.☆63Updated 3 months ago
- Example of using the Apache Arrow C Data Interface between Python and Rust☆22Updated last year
- Fast S3 in Python using Rust☆45Updated 2 years ago
- Async TIFF reader for Rust and Python☆68Updated last week
- Python bindings and arrow integration for the rust object_store crate.☆64Updated 9 months ago
- Scalable array processing with bounded memory☆195Updated 2 months ago