MrDataPsycho / data-pipelines-in-rust
Data pipeline example written in Rust with Polars and DataFusion DataFrame package
☆40Updated last year
Alternatives and similar repositories for data-pipelines-in-rust:
Users that are interested in data-pipelines-in-rust are comparing it to the libraries listed below
- ☆21Updated 9 months ago
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆62Updated last month
- ☆22Updated 3 years ago
- JSON support for DataFusion (unofficial)☆33Updated this week
- An opinionated and batteries included DataFusion implementation.☆131Updated last week
- Robust data transformation tool using SQL☆21Updated 2 years ago
- Apache Arrow Ballista Python bindings☆37Updated last year
- Rust SDK for Apache Avro - a data serialization system.☆38Updated this week
- Python binding for DataFusion☆59Updated 2 years ago
- Tantivy directory implementation backed by object_store☆30Updated last year
- Open, Multi-modal Catalog for Data & AI, written in Rust☆76Updated 4 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆83Updated this week
- Rust DataFusion Server☆13Updated last month
- DataFusion TableProviders for reading data from other systems☆79Updated this week
- S3 as an ObjectStore for DataFusion☆60Updated last year
- Experimental support for serializing DataFusion plans using substrait☆45Updated 2 years ago
- Apache Spark Connect Client for Rust☆99Updated last week
- Elusion is a high-performance DataFrame library, built on top of DataFusion SQL query engine, for managing and querying data using a Data…☆52Updated this week
- Databend SQLAlchemy☆14Updated 2 weeks ago
- Delta reader for the Ray open-source toolkit for building ML applications☆44Updated last year
- A presto/trino client library written in rust.☆40Updated last month
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆10Updated last year
- dbt-databend adapter plugin☆10Updated 8 months ago
- Rust implementation of Java Jolt JSON to JSON transformation library☆42Updated 9 months ago
- Bigtable data source for Apache Arrow DataFusion☆23Updated 2 years ago
- ☆53Updated 9 months ago
- Fluvio DuckDB Integration☆20Updated last year
- Back-end implementation of the Open Data Fabric protocol☆13Updated this week
- Serving any JSON/CSN/Parquet/Arrow files like Postgres tables with Datafusion☆26Updated last week