JackKelly / light-speed-ioLinks
Read & decompress many chunks of files at high speed
☆64Updated 3 months ago
Alternatives and similar repositories for light-speed-io
Users that are interested in light-speed-io are comparing it to the libraries listed below
Sorting:
- Rust implementation of the Zarr N-dimensional array format.☆54Updated last year
- A Rust library for the Zarr storage format for multidimensional arrays and metadata☆178Updated this week
- A minimal Python library for Apache Arrow, connecting to the Rust arrow crate☆204Updated this week
- Implementation of Zarr file format in Rust☆18Updated this week
- Rust python FS☆34Updated 2 years ago
- Rust bindings for C-Blosc☆19Updated 3 months ago
- 🐕 Concurrent HDF5 and NetCDF4 reader☆57Updated 10 months ago
- Prototype implementation of zarr v3 in rust☆18Updated last year
- A Rust crate and Python library for packed, immutable, zero-copy spatial indexes.☆167Updated last week
- Fast S3 in Python using Rust☆45Updated 2 years ago
- Building block library for using Apache Arrow in Rust WebAssembly modules.☆24Updated this week
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆97Updated 2 months ago
- ☆17Updated 3 years ago
- An experimental (work-in-progress) statically typed implementation of Apache Arrow☆20Updated last week
- High-level netCDF bindings for Rust☆94Updated last week
- Apache Arrow database client for many databases.☆44Updated 2 weeks ago
- Exchange vector geometries between Rust and Python using pyo3 and Pythons __geo_interface__ protocol☆23Updated 10 months ago
- a pure-rust 2D rasterizer for geospatial applications☆43Updated last year
- Lossless codec for numerical data☆383Updated 2 weeks ago
- A fast and memory-limited landmask based on GSHHG and OpenStreetMap for determing whether a point on Earth is on land or in the ocean.☆25Updated 4 months ago
- Async TIFF reader for Rust and Python☆71Updated 3 weeks ago
- A small helper library for working with python file-like objects with rust.☆45Updated 2 months ago
- Python bindings and arrow integration for the rust object_store crate.☆63Updated last year
- A reader that buffers ranged calls☆12Updated 3 years ago
- numcodecs Rust API for buffer compression☆12Updated last week
- Read GDAL compatible file formats into polars / geopolars☆23Updated 2 years ago
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated 4 months ago
- Pydantic models for Zarr☆37Updated last week
- Rust implementation of Supercluster for fast hierarchical point clustering☆23Updated last year
- Rust crates for the H3 geospatial indexing system☆85Updated last year