apache / datafusion-ray

Related projects ⓘ

Alternatives and complementary repositories for datafusion-ray

• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆144Updated this week
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆174Updated this week
• icelake-io / icelake
  Pure Rust Iceberg Implementation
  ☆166Updated 3 months ago
• JanKaul / iceberg-rust
  Rust implementation of Apache Iceberg with integration for Datafusion
  ☆107Updated this week
• apache / hudi-rs
  A native Rust library for Apache Hudi, with bindings into Python
  ☆146Updated this week
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆77Updated this week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆74Updated last month
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆239Updated last month
• datafusion-contrib / datafusion-table-providers
  DataFusion TableProviders for reading data from other systems
  ☆61Updated this week
• Mause / duckdb-deltatable-extension
  A purely experimental DuckDB Deltalake extension
  ☆94Updated 2 weeks ago
• lakekeeper / lakekeeper
  Lakekeeper: A Rust native Iceberg REST Catalog
  ☆234Updated this week
• datafusion-contrib / datafusion-dft
  An opinionated and batteries included DataFusion implementation.
  ☆114Updated this week
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆100Updated last month
• Kimahriman / hdfs-native
  ☆31Updated this week
• datafusion-contrib / bdt
  Boring Data Tool
  ☆209Updated 7 months ago
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆90Updated 2 weeks ago
• apache / iceberg-rust
  Apache Iceberg
  ☆658Updated this week
• duckdb / duckdb_iceberg
  ☆159Updated last month
• arrow-udf / arrow-udf
  A User-Defined Function Framework for Apache Arrow.
  ☆77Updated this week
• duckdb / extension-template
  Template for DuckDB extensions to help you develop, test and deploy a custom extension
  ☆148Updated last week
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆375Updated this week
• oliverdaff / iceberg-rs
  ☆33Updated last year
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆44Updated last year
• maxi-k / btrblocks
  BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)
  ☆228Updated 6 months ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆16Updated last month
• pacman82 / arrow-odbc
  Fill Apache Arrow record batches from an ODBC data source in Rust.
  ☆51Updated 2 weeks ago
• duckdb / duckdb_delta
  DuckDB extension for Delta Lake
  ☆136Updated last week
• uwheel / uwheel
  Embeddable Aggregate Management System for Streams and Queries.
  ☆83Updated 2 weeks ago
• kevinjqliu / iceberg-rest-catalog
  Pythonic Iceberg REST Catalog
  ☆67Updated 2 months ago