Alternatives and similar repositories for spark-connect-rs:

Users that are interested in spark-connect-rs are comparing it to the libraries listed below

• JanKaul / iceberg-rust
  Rust implementation of Apache Iceberg with integration for Datafusion
  ☆147Updated this week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆76Updated 4 months ago
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆160Updated this week
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with Python API bindings.
  ☆194Updated last week
• Kimahriman / hdfs-native
  ☆42Updated this week
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆188Updated this week
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆223Updated this week
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆164Updated 6 months ago
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆81Updated this week
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆96Updated this week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆390Updated 3 weeks ago
• datafusion-contrib / datafusion-dft
  An opinionated and batteries included DataFusion implementation.
  ☆133Updated 2 weeks ago
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆39Updated 5 months ago
• datafusion-contrib / bdt
  Boring Data Tool
  ☆213Updated 11 months ago
• oliverdaff / iceberg-rs
  ☆33Updated 2 years ago
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆243Updated 4 months ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆17Updated last week
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆84Updated this week
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆110Updated 4 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆75Updated this week
• stackabletech / trino-lb
  Trino load balancer with support for routing, queueing and auto-scaling
  ☆25Updated this week
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆414Updated this week
• lakekeeper / lakekeeper
  Lakekeeper: A Rust native Iceberg REST Catalog
  ☆451Updated this week
• apache / iceberg-rust
  Apache Iceberg
  ☆825Updated this week
• pacman82 / arrow-odbc
  Fill Apache Arrow record batches from an ODBC data source in Rust.
  ☆62Updated this week
• stackabletech / spark-k8s-operator
  Operator for Apache Spark-on-Kubernetes for Stackable Data Platform
  ☆59Updated last week
• datafusion-contrib / datafusion-materialized-views
  Incremental view maintenance & query rewriting for materialized views in DataFusion
  ☆22Updated last week
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆45Updated 2 years ago
• timvw / qv
  Quickly view your data
  ☆299Updated this week
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆86Updated last week