sjrusso8 / spark-connect-rsLinks
Apache Spark Connect Client for Rust
☆117Updated 5 months ago
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below
Sorting:
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆228Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆85Updated last year
- DataFusion TableProviders for reading data from other systems☆160Updated this week
- A native Delta implementation for integration with any query engine☆296Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆262Updated this week
- Apache DataFusion Ray☆224Updated 2 months ago
- Apache Spark Connect for Rust☆25Updated 2 months ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆420Updated 7 months ago
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆155Updated 2 weeks ago
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆297Updated this week
- TPC-H benchmark data generation in pure Rust☆215Updated last week
- Quickly view your data☆337Updated last week
- Batteries included CLI, TUI, and server implementations for DataFusion.☆182Updated 2 weeks ago
- Boring Data Tool☆237Updated last year
- Compaction runtime for Apache Iceberg.☆111Updated this week
- ☆63Updated 2 weeks ago
- Pure Rust Iceberg Implementation☆161Updated last year
- Incremental view maintenance & query rewriting for materialized views in DataFusion☆64Updated last week
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆74Updated 2 weeks ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆46Updated this week
- A leightweight UI for Lakekeeper☆15Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆133Updated 7 months ago
- Apache DataFusion Python Bindings☆530Updated last week
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 8 months ago
- JSON support for DataFusion (unofficial)☆51Updated last week
- Collection of AWS Lambdas for creating and managing Delta tables☆46Updated last month
- Apache DataFusion Benchmarks☆22Updated last week
- ☆33Updated 6 months ago
- Apache Iceberg☆1,152Updated this week
- Distributed SQL Query Engine in Python using Ray☆246Updated last year