Alternatives and similar repositories for spark-connect-rust

Users that are interested in spark-connect-rust are comparing it to the libraries listed below

• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆113Updated 3 months ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆414Updated 5 months ago
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆82Updated last year
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆43Updated last year
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆217Updated last week
• Kimahriman / hdfs-native
  ☆59Updated 2 weeks ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆254Updated this week
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆183Updated 3 weeks ago
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆21Updated last week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆221Updated 2 months ago
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆271Updated last week
• oliverdaff / iceberg-rs
  ☆33Updated 4 months ago
• nimtable / iceberg-compaction
  Compaction runtime for Apache Iceberg.
  ☆87Updated last week
• datafusion-contrib / bdt
  Boring Data Tool
  ☆235Updated last year
• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated 2 months ago
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆291Updated this week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆81Updated 5 months ago
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆319Updated this week
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆93Updated 4 months ago
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆149Updated this week
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆246Updated last year
• andygrove / qpml
  Query Plan Markup Language
  ☆45Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆162Updated last year
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆93Updated 6 months ago
• Embucket / embucket
  A BYOC option for Snowflake workloads
  ☆101Updated this week
• datafusion-contrib / datafusion-catalogprovider-glue
  ☆21Updated last year
• apache / datafusion-comet
  Apache DataFusion Comet Spark Accelerator
  ☆1,048Updated this week
• timvw / qv
  Quickly view your data
  ☆328Updated this week