datafusion-contrib / datafusion-federation
Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
☆121Updated last week
Alternatives and similar repositories for datafusion-federation:
Users that are interested in datafusion-federation are comparing it to the libraries listed below
- DataFusion TableProviders for reading data from other systems☆105Updated this week
- Rust implementation of Apache Iceberg with integration for Datafusion☆166Updated 2 weeks ago
- Apache DataFusion Ray☆184Updated 3 weeks ago
- Pure Rust Iceberg Implementation☆163Updated 8 months ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆149Updated last week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆235Updated this week
- A native Delta implementation for integration with any query engine☆221Updated this week
- TPC-H benchmark data generation in pure Rust☆53Updated this week
- JSON support for DataFusion (unofficial)☆38Updated this week
- A User-Defined Function Framework for Apache Arrow.☆89Updated 2 weeks ago
- Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow☆360Updated 8 months ago
- Apache Spark Connect Client for Rust☆106Updated 2 months ago
- Boring Data Tool☆217Updated last year
- Convert sequences of Rust objects to Arrow tables☆83Updated last week
- Message queue and data streaming based on cloud native services.☆109Updated this week
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆67Updated last week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆116Updated this week
- 10x lower latency for cloud-native DataFusion☆134Updated this week
- Experimental support for serializing DataFusion plans using substrait☆45Updated 2 years ago
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆66Updated this week
- Rust object_store crate☆36Updated this week
- Serving any JSON/CSN/Parquet/Arrow files like Postgres tables with Datafusion☆30Updated last week
- The native Rust implementation for Apache Hudi, with Python API bindings.☆209Updated this week
- Embeddable Aggregate Management System for Streams and Queries.☆90Updated this week
- ☆55Updated 11 months ago
- Rust implementation of the FastLanes compression library☆100Updated 3 weeks ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆78Updated 6 months ago
- Distributed SQL Query Engine in Python using Ray☆243Updated 6 months ago
- S3 as an ObjectStore for DataFusion☆61Updated 2 years ago
- Sqllogictest (dialect with extensions) parser and runner in Rust.☆190Updated this week