sjrusso8 / spark-connect-rsLinks
Apache Spark Connect Client for Rust
☆111Updated last month
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below
Sorting:
- Open, Multi-modal Catalog for Data & AI, written in Rust☆81Updated 10 months ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆212Updated this week
- A native Delta implementation for integration with any query engine☆238Updated this week
- Apache DataFusion Ray☆214Updated 4 months ago
- DataFusion TableProviders for reading data from other systems☆135Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆245Updated 2 weeks ago
- Apache Spark Connect for Rust☆18Updated last week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆412Updated 3 months ago
- Quickly view your data☆324Updated last month
- Boring Data Tool☆226Updated last year
- TPC-H benchmark data generation in pure Rust☆118Updated this week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆139Updated last week
- ☆54Updated 2 weeks ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆162Updated last month
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆273Updated this week
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆42Updated 10 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆92Updated 4 months ago
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆71Updated last month
- JSON support for DataFusion (unofficial)☆45Updated last week
- Apache Iceberg☆1,043Updated this week
- A leightweight UI for Lakekeeper☆14Updated this week
- Apache DataFusion Python Bindings☆482Updated last week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆870Updated this week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆829Updated this week
- Collection of AWS Lambdas for creating and managing Delta tables☆43Updated 3 weeks ago
- Comptaction runtime for Apache Iceberg.☆60Updated last week
- ☆21Updated last year
- S3 as an ObjectStore for DataFusion☆64Updated 2 years ago
- ☆33Updated 2 months ago
- Apache DataFusion Comet Spark Accelerator☆1,013Updated this week