sjrusso8 / spark-connect-rsLinks
Apache Spark Connect Client for Rust
☆114Updated 4 months ago
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below
Sorting:
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆221Updated last week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆82Updated last year
- A native Delta implementation for integration with any query engine☆271Updated last week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆255Updated this week
- DataFusion TableProviders for reading data from other systems☆155Updated this week
- Apache DataFusion Ray☆221Updated 3 weeks ago
- Apache Spark Connect for Rust☆23Updated 3 weeks ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆165Updated last week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆414Updated 5 months ago
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆294Updated this week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆151Updated last month
- ☆59Updated 2 weeks ago
- Boring Data Tool☆235Updated last year
- Quickly view your data☆330Updated this week
- Compaction runtime for Apache Iceberg.☆100Updated this week
- JSON support for DataFusion (unofficial)☆48Updated last month
- TPC-H benchmark data generation in pure Rust☆202Updated last month
- Incremental view maintenance & query rewriting for materialized views in DataFusion☆53Updated this week
- Pure Rust Iceberg Implementation☆162Updated last year
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆43Updated last year
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆74Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆132Updated 6 months ago
- Apache DataFusion Python Bindings☆513Updated this week
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 7 months ago
- ☆33Updated 5 months ago
- Apache Iceberg☆1,110Updated this week
- Experimental support for serializing DataFusion plans using substrait☆46Updated 2 years ago
- Apache DataFusion Benchmarks☆22Updated 3 weeks ago
- A leightweight UI for Lakekeeper☆15Updated this week
- Collection of AWS Lambdas for creating and managing Delta tables☆46Updated last week