JackKelly / light-speed-ioLinks
Read & decompress many chunks of files at high speed
☆64Updated 2 months ago
Alternatives and similar repositories for light-speed-io
Users that are interested in light-speed-io are comparing it to the libraries listed below
Sorting:
- Rust implementation of the Zarr N-dimensional array format.☆54Updated last year
- A Rust library for the Zarr storage format for multidimensional arrays and metadata☆163Updated last week
- Implementation of Zarr file format in Rust☆17Updated 2 weeks ago
- Rust python FS☆34Updated 2 years ago
- A minimal Python library for Apache Arrow, connecting to the Rust arrow crate☆202Updated this week
- 🐕 Concurrent HDF5 and NetCDF4 reader☆57Updated 9 months ago
- Fast S3 in Python using Rust☆45Updated 2 years ago
- Prototype implementation of zarr v3 in rust☆18Updated last year
- Rust bindings for C-Blosc☆19Updated 3 months ago
- Exchange vector geometries between Rust and Python using pyo3 and Pythons __geo_interface__ protocol☆23Updated 9 months ago
- A fast and memory-limited landmask based on GSHHG and OpenStreetMap for determing whether a point on Earth is on land or in the ocean.☆25Updated 4 months ago
- A Rust crate and Python library for packed, immutable, zero-copy spatial indexes.☆164Updated last month
- a pure-rust 2D rasterizer for geospatial applications☆43Updated last year
- Building block library for using Apache Arrow in Rust WebAssembly modules.☆24Updated this week
- Various tools for creating and manipulating Zarr V3 data with the zarrs Rust crate☆24Updated 3 weeks ago
- Is the GIL seeing someone else? How's about repetitively calling and seeing how long it takes to answer?☆15Updated 9 months ago
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated 4 months ago
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆96Updated last month
- Python bindings and arrow integration for the rust object_store crate.☆63Updated 11 months ago
- An experimental (work-in-progress) statically typed implementation of Apache Arrow☆20Updated last week
- High-level netCDF bindings for Rust☆92Updated last month
- Apache Arrow database client for many databases.☆44Updated this week
- Rust implementation of Supercluster for fast hierarchical point clustering☆23Updated last year
- ☆17Updated 3 years ago
- Lossless codec for numerical data☆379Updated last week
- Performance benchmarks of Zarr V3 implementations☆15Updated last week
- Read GRIB files with Rust☆56Updated 2 weeks ago
- Fast, pure-Rust reader and writer for Well-Known Binary geometries☆30Updated 2 months ago
- ☆89Updated 6 months ago
- A Python protocol for interfacing with object storage.☆27Updated last month