Alternatives and similar repositories for spark-connect-rust

Users that are interested in spark-connect-rust are comparing it to the libraries listed below

• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆114Updated 4 months ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆414Updated 5 months ago
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆271Updated last week
• nimtable / iceberg-compaction
  Compaction runtime for Apache Iceberg.
  ☆100Updated this week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆82Updated last year
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆221Updated last week
• datafusion-contrib / bdt
  Boring Data Tool
  ☆235Updated last year
• andygrove / qpml
  Query Plan Markup Language
  ☆45Updated last year
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆255Updated last week
• Kimahriman / hdfs-native
  ☆59Updated 2 weeks ago
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆22Updated 3 weeks ago
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆43Updated last year
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆294Updated this week
• datafusion-contrib / datafusion-materialized-views
  Incremental view maintenance & query rewriting for materialized views in DataFusion
  ☆53Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆221Updated 3 weeks ago
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆95Updated 7 months ago
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆155Updated this week
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆165Updated last week
• Embucket / embucket
  A BYOC option for Snowflake workloads
  ☆101Updated this week
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆202Updated last month
• lakehq / sail
  LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.
  ☆1,018Updated this week
• apache / datafusion-comet
  Apache DataFusion Comet Spark Accelerator
  ☆1,055Updated last week
• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆81Updated 6 months ago
• JanKaul / frostbow
  ☆14Updated 3 weeks ago
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆151Updated last month
• pacman82 / arrow-odbc
  Fill Apache Arrow record batches from an ODBC data source in Rust.
  ☆74Updated this week
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆246Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆231Updated 3 months ago
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆46Updated 2 years ago