Alternatives and similar repositories for spark-connect-rs

Users that are interested in spark-connect-rs are comparing it to the libraries listed below

• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆81Updated 9 months ago
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆205Updated this week
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆230Updated last week
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆129Updated last week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆209Updated 3 months ago
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆236Updated this week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆408Updated 2 months ago
• timvw / qv
  Quickly view your data
  ☆318Updated last week
• Kimahriman / hdfs-native
  ☆53Updated last week
• datafusion-contrib / bdt
  Boring Data Tool
  ☆224Updated last year
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆158Updated 3 weeks ago
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆259Updated last week
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆92Updated 3 months ago
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆41Updated 9 months ago
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆137Updated this week
• clflushopt / tpchgen-rs
  TPC-H benchmark data generation in pure Rust
  ☆112Updated this week
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆163Updated 11 months ago
• oliverdaff / iceberg-rs
  ☆33Updated 2 months ago
• datafusion-contrib / datafusion-objectstore-s3
  S3 as an ObjectStore for DataFusion
  ☆64Updated 2 years ago
• apache / iceberg-rust
  Apache Iceberg
  ☆1,014Updated this week
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆464Updated last week
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆243Updated 9 months ago
• lakehq / sail
  LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.
  ☆824Updated this week
• pacman82 / arrow-odbc
  Fill Apache Arrow record batches from an ODBC data source in Rust.
  ☆72Updated 2 weeks ago
• nimtable / iceberg-compaction
  Comptaction runtime for Apache Iceberg.
  ☆47Updated this week
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆128Updated 2 months ago
• dremio-hub / arrow-flight-client-examples
  ☆70Updated 6 months ago
• buoyant-data / oxbow
  Collection of AWS Lambdas for creating and managing Delta tables
  ☆38Updated 2 weeks ago
• jorgecarleitao / parquet2
  Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow
  ☆362Updated 11 months ago
• kamu-data / kamu-cli
  Next-generation decentralized data lakehouse and a multi-party stream processing network
  ☆323Updated this week