MrDataPsycho / data-pipelines-in-rust
Data pipeline example written in Rust with Polars and DataFusion DataFrame package
☆40Updated 2 years ago
Alternatives and similar repositories for data-pipelines-in-rust:
Users that are interested in data-pipelines-in-rust are comparing it to the libraries listed below
- JSON support for DataFusion (unofficial)☆38Updated last week
- ☆21Updated 10 months ago
- dbt-databend adapter plugin☆10Updated 9 months ago
- Experimental support for serializing DataFusion plans using substrait☆45Updated 2 years ago
- ☆22Updated 3 years ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆141Updated this week
- Apache Arrow Ballista Python bindings☆37Updated last year
- Open, Multi-modal Catalog for Data & AI, written in Rust☆78Updated 5 months ago
- ☆87Updated 2 weeks ago
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆63Updated last week
- Tantivy directory implementation backed by object_store☆31Updated last year
- Robust data transformation tool using SQL☆21Updated 2 years ago
- Databend Native Client☆55Updated last week
- Python binding for DataFusion☆59Updated 2 years ago
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆63Updated this week
- A presto/trino client library written in rust.☆41Updated 2 months ago
- S3 as an ObjectStore for DataFusion☆61Updated 2 years ago
- DataFusion TableProviders for reading data from other systems☆92Updated this week
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆10Updated last year
- Generated Rust of Apache Arrow spec☆16Updated last year
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆106Updated last week
- ☆54Updated 10 months ago
- Rust SDK for Apache Avro - a data serialization system.☆47Updated this week
- SQL Benchmark derived from TPC-DS☆15Updated last year
- A Minimalistic Rust Implementation of Delta Sharing Server.☆88Updated this week
- ☆18Updated 2 years ago
- Embeddable Aggregate Management System for Streams and Queries.☆91Updated 2 months ago
- Rust DataFusion Server☆14Updated last month
- A DataFusion-powered Serverless S3 Proxy.☆16Updated 11 months ago
- Pure Rust Iceberg Implementation☆163Updated 7 months ago