Alternatives and similar repositories for spark-connect-rs

Users that are interested in spark-connect-rs are comparing it to the libraries listed below

• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆125Updated last week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆80Updated 8 months ago
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆200Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆202Updated 2 months ago
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆234Updated last week
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆135Updated this week
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆91Updated 2 weeks ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆225Updated last week
• Kimahriman / hdfs-native
  ☆51Updated last month
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆156Updated this week
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆256Updated this week
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆163Updated 10 months ago
• pacman82 / arrow-odbc
  Fill Apache Arrow record batches from an ODBC data source in Rust.
  ☆72Updated this week
• datafusion-contrib / datafusion-functions-json
  JSON support for DataFusion (unofficial)
  ☆42Updated last week
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆40Updated 9 months ago
• nimtable / nimtable
  The Control Plane for Apache Iceberg
  ☆128Updated this week
• datafusion-contrib / bdt
  Boring Data Tool
  ☆223Updated last year
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆92Updated 3 months ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆407Updated last month
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆19Updated 4 months ago
• oliverdaff / iceberg-rs
  ☆33Updated last month
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆95Updated 2 weeks ago
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆45Updated 2 years ago
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆126Updated 2 months ago
• lakekeeper / console
  A leightweight UI for Lakekeeper
  ☆13Updated last week
• apache / arrow-rs-object-store
  Rust object_store crate
  ☆75Updated last week
• timvw / qv
  Quickly view your data
  ☆315Updated last week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆79Updated 2 months ago
• nooberfsh / prusto
  A presto/trino client library written in rust.
  ☆42Updated 6 months ago
• datafusion-contrib / datafusion-postgres
  Postgres protocol frontend for DataFusion
  ☆63Updated this week