Alternatives and similar repositories for spark-connect-rust

Users that are interested in spark-connect-rust are comparing it to the libraries listed below

• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆111Updated 2 months ago
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆81Updated 10 months ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆411Updated 3 months ago
• Kimahriman / hdfs-native
  ☆56Updated last week
• datafusion-contrib / bdt
  Boring Data Tool
  ☆227Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆229Updated last month
• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• kaiko-ai / typedspark
  Column-wise type annotations for pyspark DataFrames
  ☆84Updated this week
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆131Updated this week
• andygrove / qpml
  Query Plan Markup Language
  ☆45Updated last year
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆91Updated 3 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated 11 months ago
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆293Updated 2 weeks ago
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆249Updated last week
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆42Updated 11 months ago
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆92Updated 5 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆235Updated 2 months ago
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆214Updated last week
• AbsaOSS / spark-hats
  Nested array transformation helper extensions for Apache Spark
  ☆37Updated 2 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated this week
• lakehq / sail
  LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.
  ☆886Updated last week
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated last month
• datafusion-contrib / datafusion-catalogprovider-glue
  ☆21Updated last year
• tokoko / SparkFlightSql
  ☆10Updated 2 months ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆248Updated this week
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆262Updated 10 months ago
• Embucket / embucket
  A BYOC option for Snowflake workloads
  ☆89Updated this week
• timvw / qv
  Quickly view your data
  ☆324Updated 2 weeks ago