sjrusso8 / spark-connect-rs

Related projects ⓘ

Alternatives and complementary repositories for spark-connect-rs

• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆74Updated last month
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆118Updated this week
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆146Updated this week
• JanKaul / iceberg-rust
  Rust implementation of Apache Iceberg with integration for Datafusion
  ☆109Updated this week
• apache / hudi-rs
  A native Rust library for Apache Hudi, with bindings into Python
  ☆149Updated this week
• lakekeeper / lakekeeper
  Lakekeeper: A Rust native Iceberg REST Catalog
  ☆235Updated this week
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆82Updated 3 months ago
• Kimahriman / hdfs-native
  ☆32Updated this week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆370Updated last week
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆192Updated this week
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆166Updated 3 months ago
• datafusion-contrib / datafusion-streams
  ☆21Updated 2 years ago
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆77Updated last week
• kevinjqliu / iceberg-rest-catalog
  Pythonic Iceberg REST Catalog
  ☆67Updated 2 months ago
• apache / iceberg-rust
  Apache Iceberg
  ☆674Updated this week
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆44Updated last year
• datafusion-contrib / datafusion-dft
  An opinionated and batteries included DataFusion implementation.
  ☆115Updated this week
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆62Updated this week
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆100Updated last month
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆37Updated 2 months ago
• oliverdaff / iceberg-rs
  ☆33Updated last year
• datafusion-contrib / bdt
  Boring Data Tool
  ☆210Updated 8 months ago
• lakehq / sail
  LakeSail's computation framework with a mission to unify stream processing, batch processing, and compute-intensive (AI) workloads.
  ☆447Updated this week
• dbt-labs / dbt-extractor
  ☆26Updated 5 months ago
• duckdb / duckdb_iceberg
  ☆160Updated last month
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆43Updated 9 months ago
• Mause / duckdb-deltatable-extension
  A purely experimental DuckDB Deltalake extension
  ☆94Updated 2 weeks ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated 5 months ago
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆376Updated last week