sjrusso8 / spark-connect-rsLinks
Apache Spark Connect Client for Rust
☆111Updated 2 months ago
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below
Sorting:
- Open, Multi-modal Catalog for Data & AI, written in Rust☆81Updated 10 months ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆214Updated last week
- DataFusion TableProviders for reading data from other systems☆136Updated this week
- Apache DataFusion Ray☆218Updated 3 weeks ago
- A native Delta implementation for integration with any query engine☆249Updated last week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆248Updated this week
- ☆56Updated last week
- Batteries included CLI, TUI, and server implementations for DataFusion.☆163Updated 2 months ago
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆141Updated last week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆411Updated 3 months ago
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆278Updated this week
- TPC-H benchmark data generation in pure Rust☆131Updated this week
- Quickly view your data☆324Updated 2 weeks ago
- Boring Data Tool☆227Updated last year
- Apache Spark Connect for Rust☆20Updated 2 weeks ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆42Updated 11 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆92Updated 5 months ago
- Pure Rust Iceberg Implementation☆162Updated last year
- JSON support for DataFusion (unofficial)☆46Updated 3 weeks ago
- ☆33Updated 3 months ago
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆72Updated last week
- A leightweight UI for Lakekeeper☆15Updated this week
- Comptaction runtime for Apache Iceberg.☆70Updated last week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆129Updated 4 months ago
- S3 as an ObjectStore for DataFusion☆65Updated 2 years ago
- Experimental support for serializing DataFusion plans using substrait☆45Updated 2 years ago
- ☆23Updated 3 years ago
- Apache Iceberg☆1,062Updated this week
- Incremental view maintenance & query rewriting for materialized views in DataFusion☆43Updated 3 weeks ago
- Distributed SQL Query Engine in Python using Ray☆244Updated 10 months ago