sjrusso8 / spark-connect-rsLinks
Apache Spark Connect Client for Rust
☆113Updated 3 months ago
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below
Sorting:
- Open, Multi-modal Catalog for Data & AI, written in Rust☆82Updated last year
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆217Updated last week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆254Updated this week
- Apache DataFusion Ray☆221Updated 2 months ago
- A native Delta implementation for integration with any query engine☆271Updated last week
- DataFusion TableProviders for reading data from other systems☆149Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆414Updated 5 months ago
- Apache Spark Connect for Rust☆21Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆291Updated this week
- ☆59Updated 2 weeks ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆165Updated 3 months ago
- Quickly view your data☆328Updated this week
- Boring Data Tool☆235Updated last year
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆149Updated 2 weeks ago
- TPC-H benchmark data generation in pure Rust☆183Updated 3 weeks ago
- Compaction runtime for Apache Iceberg.☆87Updated last week
- Pure Rust Iceberg Implementation☆162Updated last year
- ☆33Updated 4 months ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆43Updated last year
- A leightweight UI for Lakekeeper☆15Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆130Updated 5 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆93Updated 6 months ago
- Apache Iceberg☆1,098Updated last week
- Apache DataFusion Python Bindings☆507Updated this week
- Distributed SQL Query Engine in Python using Ray☆246Updated last year
- S3 as an ObjectStore for DataFusion☆65Updated 2 years ago
- Apache DataFusion Benchmarks☆21Updated last week
- Collection of AWS Lambdas for creating and managing Delta tables☆45Updated 2 weeks ago
- ☆23Updated 3 years ago
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆81Updated 5 months ago