datafusion-contrib / datafusion-federationLinks
Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
☆135Updated this week
Alternatives and similar repositories for datafusion-federation
Users that are interested in datafusion-federation are comparing it to the libraries listed below
Sorting:
- DataFusion TableProviders for reading data from other systems☆125Updated last week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆200Updated this week
- Apache DataFusion Ray☆202Updated 2 months ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆156Updated this week
- Pure Rust Iceberg Implementation☆163Updated 10 months ago
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆256Updated this week
- JSON support for DataFusion (unofficial)☆42Updated last week
- TPC-H benchmark data generation in pure Rust☆91Updated 2 weeks ago
- A native Delta implementation for integration with any query engine☆234Updated last week
- Postgres protocol frontend for DataFusion☆63Updated this week
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆71Updated this week
- A User-Defined Function Framework for Apache Arrow.☆95Updated 2 weeks ago
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆225Updated last week
- Distributed pushdown cache for DataFusion☆184Updated this week
- Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow☆361Updated 10 months ago
- Apache Paimon Rust The rust implementation of Apache Paimon.☆126Updated 2 months ago
- Message queue and data streaming based on cloud native services.☆111Updated 2 months ago
- Apache Spark Connect Client for Rust☆109Updated 2 weeks ago
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆72Updated this week
- Rust object_store crate☆75Updated last week
- Implementation of Apache ORC file format use Apache Arrow in-memory format☆43Updated 5 months ago
- View parquet files online☆160Updated last week
- Convert sequences of Rust objects to Arrow tables☆88Updated 2 weeks ago
- Experimental support for serializing DataFusion plans using substrait☆45Updated 2 years ago
- Incremental view maintenance & query rewriting for materialized views in DataFusion☆37Updated this week
- Boring Data Tool☆223Updated last year
- Optimizer for DataFusion based on the egg framework☆14Updated 3 years ago
- ☆55Updated last year
- µWheel DataFusion Optimizer for speeding up time-based analytics☆38Updated 2 months ago
- WASM bindings for DataFusion☆26Updated last month