apache / spark-connect-rustLinks
Apache spark
☆18Updated this week
Alternatives and similar repositories for spark-connect-rust
Users that are interested in spark-connect-rust are comparing it to the libraries listed below
Sorting:
- Apache Spark Connect Client for Rust☆110Updated last month
- Open, Multi-modal Catalog for Data & AI, written in Rust☆81Updated 9 months ago
- A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL☆41Updated 10 months ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆410Updated 2 months ago
- ☆54Updated this week
- Boring Data Tool☆225Updated last year
- ☆106Updated 2 years ago
- Drop-in replacement for Apache Spark UI☆277Updated last week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆207Updated last week
- Query Plan Markup Language☆45Updated last year
- Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…☆90Updated 2 months ago
- Avro SerDe for Apache Spark structured APIs.☆235Updated last month
- A native Delta implementation for integration with any query engine☆237Updated this week
- A library that brings useful functions from various modern database management systems to Apache Spark☆60Updated last year
- CLI tool to bulk migrate the tables from one catalog another without a data copy☆80Updated 3 months ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆45Updated last week
- A library that provides useful extensions to Apache Spark and PySpark.☆228Updated last week
- Flowchart for debugging Spark applications☆105Updated 10 months ago
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆238Updated last week
- Kafka Connector for Iceberg tables☆16Updated 2 years ago
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆19Updated 5 months ago
- Quickly view your data☆322Updated 3 weeks ago
- Comptaction runtime for Apache Iceberg.☆57Updated this week
- ☆33Updated 2 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆92Updated 4 months ago
- ☆21Updated last year
- TPC-H benchmark data generation in pure Rust☆117Updated this week
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆186Updated 2 years ago
- Multi-hop declarative data pipelines☆117Updated this week
- Apache DataFusion Ray☆210Updated 3 months ago