JackKelly / light-speed-ioLinks
Read & decompress many chunks of files at high speed
☆63Updated last month
Alternatives and similar repositories for light-speed-io
Users that are interested in light-speed-io are comparing it to the libraries listed below
Sorting:
- Rust implementation of the Zarr N-dimensional array format.☆54Updated last year
- A Rust library for the Zarr storage format for multidimensional arrays and metadata☆150Updated this week
- 🐕 Concurrent HDF5 and NetCDF4 reader☆57Updated 8 months ago
- Rust python FS☆34Updated 2 years ago
- Prototype implementation of zarr v3 in rust☆18Updated last year
- Various tools for creating and manipulating Zarr V3 data with the zarrs Rust crate☆23Updated 2 weeks ago
- Lazily open petabyte-scale GRIB datasets consisting of trillions of GRIB messages from xarray☆45Updated 2 months ago
- A minimal Python library for Apache Arrow, connecting to the Rust arrow crate☆160Updated 2 weeks ago
- Building block library for using Apache Arrow in Rust WebAssembly modules.☆24Updated 3 weeks ago
- Zarr core protocol for storage and retrieval of N-dimensional typed arrays☆94Updated this week
- A self-paced course to write Python extensions in Rust, one exercise at a time.☆64Updated 2 weeks ago
- An experimental (work-in-progress) statically typed implementation of Apache Arrow☆19Updated this week
- Python bindings and arrow integration for the rust object_store crate.☆64Updated 10 months ago
- Rust bindings for C-Blosc☆19Updated last month
- A zarrs-backed CodecPipeline for zarr-python☆36Updated last month
- Implementation of Zarr file format in Rust☆14Updated 3 weeks ago
- a pure-rust 2D rasterizer for geospatial applications☆42Updated last year
- A Rust crate and Python library for packed, immutable, zero-copy spatial indexes.☆161Updated last week
- Is the GIL seeing someone else? How's about repetitively calling and seeing how long it takes to answer?☆15Updated 8 months ago
- A fast and memory-limited landmask based on GSHHG and OpenStreetMap for determing whether a point on Earth is on land or in the ocean.☆24Updated 2 months ago
- Fast S3 in Python using Rust☆45Updated 2 years ago
- ☆17Updated 2 years ago
- Example of using the Apache Arrow C Data Interface between Python and Rust☆22Updated last year
- Apache Arrow database client for many databases.☆42Updated last week
- Experimental Vega visualization renderer in Rust using wgpu☆42Updated this week
- Rust library for accessing geospatial raster images☆29Updated 5 months ago
- Pydantic models for Zarr☆32Updated 2 weeks ago
- Zarr Enhancement Proposals☆14Updated 4 months ago
- Rust implementation of the N5 "Not HDF5" tensor file system format☆15Updated 2 years ago
- High-level netCDF bindings for Rust☆90Updated last week