MrDataPsycho / data-pipelines-in-rustLinks
Data pipeline example written in Rust with Polars and DataFusion DataFrame package
☆41Updated 2 years ago
Alternatives and similar repositories for data-pipelines-in-rust
Users that are interested in data-pipelines-in-rust are comparing it to the libraries listed below
Sorting:
- Tantivy directory implementation backed by object_store☆36Updated last year
- ☆21Updated last year
- ☆23Updated 3 years ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆165Updated 3 months ago
- dbt-databend adapter plugin☆10Updated last year
- Open, Multi-modal Catalog for Data & AI, written in Rust☆82Updated last year
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆72Updated this week
- Robust data transformation tool using SQL☆21Updated 2 years ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆93Updated 6 months ago
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆13Updated 7 months ago
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆77Updated last week
- Postgres protocol frontend for DataFusion☆101Updated this week
- Python binding for DataFusion☆59Updated 3 years ago
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆149Updated 2 weeks ago
- S3 as an ObjectStore for DataFusion☆65Updated 2 years ago
- ☆107Updated 2 weeks ago
- DataFusion TableProviders for reading data from other systems☆149Updated this week
- JSON support for DataFusion (unofficial)☆48Updated 2 weeks ago
- ☆17Updated 2 years ago
- Experimental support for serializing DataFusion plans using substrait☆46Updated 2 years ago
- SQL Benchmark derived from TPC-DS☆15Updated 2 years ago
- Databend Native Client☆59Updated last week
- A presto/trino client library written in rust.☆43Updated 9 months ago
- Apache Spark Connect Client for Rust☆113Updated 3 months ago
- Compaction runtime for Apache Iceberg.☆87Updated last week
- Embeddable Aggregate Management System for Streams and Queries.☆96Updated 5 months ago
- Rust based high-performance Apache Uniffle shuffle-server☆42Updated last week
- Make ETLs Great Again!☆43Updated 2 years ago
- OpenDAL fsspec integration☆30Updated 4 months ago
- Framework to build data pipelines declaratively☆92Updated this week