Alternatives and similar repositories for spark-connect-rs:

Users that are interested in spark-connect-rs are comparing it to the libraries listed below

• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆78Updated 6 months ago
• JanKaul / iceberg-rust
  Rust implementation of Apache Iceberg with integration for Datafusion
  ☆153Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆174Updated 3 weeks ago
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆207Updated this week
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with Python API bindings.
  ☆205Updated last week
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆93Updated this week
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆163Updated 7 months ago
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆39Updated 6 months ago
• Kimahriman / hdfs-native
  ☆44Updated 3 weeks ago
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆142Updated this week
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆230Updated this week
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆89Updated 2 weeks ago
• datafusion-contrib / bdt
  Boring Data Tool
  ☆214Updated last year
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆112Updated 3 weeks ago
• timvw / qv
  Quickly view your data
  ☆303Updated 3 weeks ago
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆45Updated 2 years ago
• datafusion-contrib / datafusion-materialized-views
  Incremental view maintenance & query rewriting for materialized views in DataFusion
  ☆27Updated this week
• oliverdaff / iceberg-rs
  ☆33Updated 2 years ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆393Updated 3 weeks ago
• datafusion-contrib / datafusion-streams
  ☆22Updated 3 years ago
• andygrove / qpml
  Query Plan Markup Language
  ☆45Updated last year
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆429Updated last week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆76Updated last month
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆17Updated last month
• Mause / duckdb-deltatable-extension
  A purely experimental DuckDB Deltalake extension
  ☆95Updated this week
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆243Updated 5 months ago
• duckdb / duckdb-iceberg
  ☆244Updated this week
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆88Updated last week
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆111Updated 6 months ago