MrDataPsycho / data-pipelines-in-rustLinks
Data pipeline example written in Rust with Polars and DataFusion DataFrame package
☆41Updated 2 years ago
Alternatives and similar repositories for data-pipelines-in-rust
Users that are interested in data-pipelines-in-rust are comparing it to the libraries listed below
Sorting:
- ☆23Updated last year
- Tantivy directory implementation backed by object_store☆40Updated 2 years ago
- ☆23Updated 4 years ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆188Updated 2 weeks ago
- Python binding for DataFusion☆59Updated 3 years ago
- S3 as an ObjectStore for DataFusion☆68Updated 2 years ago
- Open, Multi-modal Catalog for Data & AI, written in Rust☆86Updated last year
- Robust data transformation tool using SQL☆22Updated 3 years ago
- dbt-databend adapter plugin☆10Updated last year
- Postgres protocol frontend for DataFusion☆127Updated last week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆164Updated 3 weeks ago
- JSON support for DataFusion (unofficial)☆55Updated 3 weeks ago
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆84Updated this week
- OpenData is a collection of open source databases built on a common, object-native storage and infrastructure foundation.☆81Updated this week
- ☆117Updated 3 weeks ago
- Convert your docker-compose into excalidraw☆129Updated last year
- Rust DataFusion Server☆25Updated last week
- Framework to build data pipelines declaratively☆94Updated 2 months ago
- Databend Native Client☆59Updated 2 weeks ago
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆76Updated 2 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆96Updated 10 months ago
- Example of using the Apache Arrow C Data Interface between Python and Rust☆24Updated 2 years ago
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆10Updated last year
- Experimental support for serializing DataFusion plans using substrait☆46Updated 3 years ago
- Apache Spark Connect Client for Rust☆118Updated 8 months ago
- Rust based high-performance Apache Uniffle shuffle-server☆60Updated last week
- A cli for spinning up and managing Ray clusters for the Daft Query Engine.☆15Updated 11 months ago
- A presto/trino client library written in rust.☆42Updated last year
- ☆17Updated 3 years ago
- Minimal, exact vector search with metadata filtering. Think "Polars for vector search."☆33Updated last week