sjrusso8 / spark-connect-rsLinks
Apache Spark Connect Client for Rust
☆118Updated 7 months ago
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below
Sorting:
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆231Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆85Updated last year
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆266Updated this week
- A native Delta implementation for integration with any query engine☆305Updated this week
- DataFusion TableProviders for reading data from other systems☆162Updated this week
- Apache DataFusion Ray☆228Updated 3 months ago
- Apache Spark Connect for Rust☆25Updated 3 months ago
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆306Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆424Updated 8 months ago
- Quickly view your data☆342Updated last week
- Batteries included CLI, TUI, and server implementations for DataFusion.☆185Updated last month
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆162Updated last month
- Boring Data Tool☆239Updated last year
- TPC-H benchmark data generation in pure Rust☆218Updated this week
- Incremental view maintenance & query rewriting for materialized views in DataFusion☆67Updated 2 weeks ago
- ☆67Updated last week
- Pure Rust Iceberg Implementation☆162Updated last year
- Compaction runtime for Apache Iceberg.☆113Updated this week
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 9 months ago
- Apache Paimon Rust The rust implementation of Apache Paimon.☆137Updated 8 months ago
- JSON support for DataFusion (unofficial)☆55Updated 3 weeks ago
- Apache Iceberg☆1,193Updated this week
- Apache DataFusion Python Bindings☆549Updated this week
- A leightweight UI for Lakekeeper☆16Updated this week
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆75Updated last month
- Apache DataFusion Benchmarks☆23Updated last week
- Apache Arrow Ballista Python bindings☆39Updated last year
- Collection of AWS Lambdas for creating and managing Delta tables☆54Updated this week
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆46Updated 3 weeks ago
- S3 as an ObjectStore for DataFusion☆67Updated 2 years ago