datafusion-contrib / datafusion-federation
Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
☆94Updated this week
Alternatives and similar repositories for datafusion-federation:
Users that are interested in datafusion-federation are comparing it to the libraries listed below
- DataFusion TableProviders for reading data from other systems☆79Updated this week
- Rust implementation of Apache Iceberg with integration for Datafusion☆140Updated this week
- An opinionated and batteries included DataFusion implementation.☆131Updated last week
- Apache DataFusion Ray☆157Updated this week
- Pure Rust Iceberg Implementation☆164Updated 6 months ago
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆62Updated this week
- A native Delta implementation for integration with any query engine☆186Updated last week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆220Updated this week
- Embeddable Aggregate Management System for Streams and Queries.☆90Updated last month
- JSON support for DataFusion (unofficial)☆33Updated this week
- A User-Defined Function Framework for Apache Arrow.☆86Updated this week
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆62Updated last month
- Rust implementation of the FastLanes compression library☆94Updated 3 weeks ago
- Apache Paimon Rust The rust implementation of Apache Paimon.☆109Updated 4 months ago
- A set of tools for writing servers that speak PostgreSQL's wire protocol☆90Updated last month
- Experimental support for serializing DataFusion plans using substrait☆45Updated 2 years ago
- Convert sequences of Rust objects to Arrow tables☆73Updated last week
- ☆53Updated 9 months ago
- µWheel DataFusion Optimizer for speeding up time-based analytics☆30Updated last month
- A presto/trino client library written in rust.☆40Updated last month
- Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow☆358Updated 6 months ago
- S3 as an ObjectStore for DataFusion☆60Updated last year
- Boring Data Tool☆213Updated 10 months ago
- Pure-Rust implementation of Fast Static Symbol Tables string compression☆121Updated this week
- Message queue and data streaming based on cloud native services.☆102Updated 3 weeks ago
- Sqllogictest (dialect with extensions) parser and runner in Rust.☆186Updated this week
- Implementation of Apache ORC file format use Apache Arrow in-memory format☆44Updated last month
- Serving any JSON/CSN/Parquet/Arrow files like Postgres tables with Datafusion☆26Updated last week
- K.I.S.S. LSM-tree implementation in safe Rust☆177Updated this week
- The native Rust implementation for Apache Hudi, with Python API bindings.☆193Updated this week