MrDataPsycho / data-pipelines-in-rustLinks
Data pipeline example written in Rust with Polars and DataFusion DataFrame package
☆41Updated 2 years ago
Alternatives and similar repositories for data-pipelines-in-rust
Users that are interested in data-pipelines-in-rust are comparing it to the libraries listed below
Sorting:
- ☆21Updated last year
- ☆23Updated 3 years ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆165Updated last week
- Tantivy directory implementation backed by object_store☆36Updated last year
- S3 as an ObjectStore for DataFusion☆66Updated 2 years ago
- Python binding for DataFusion☆59Updated 3 years ago
- Robust data transformation tool using SQL☆22Updated 2 years ago
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆152Updated this week
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆74Updated this week
- Experimental support for serializing DataFusion plans using substrait☆46Updated 2 years ago
- Rust DataFusion Server☆23Updated last week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆82Updated last year
- Postgres protocol frontend for DataFusion☆106Updated this week
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆80Updated last week
- JSON support for DataFusion (unofficial)☆48Updated last month
- dbt-databend adapter plugin☆10Updated last year
- DataFusion TableProviders for reading data from other systems☆155Updated this week
- Apache Spark Connect Client for Rust☆114Updated 4 months ago
- ☆114Updated 3 weeks ago
- Pure Rust Iceberg Implementation☆162Updated last year
- Databend Native Client☆59Updated this week
- 🦀Rust + Large Language Models - Make AI Services Freely and Easily.☆182Updated last year
- Arrow, pydantic style☆85Updated 2 years ago
- A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between …☆61Updated 4 years ago
- Minimal, exact vector search with metadata filtering. Think "Polars for vector search."☆30Updated this week
- Framework to build data pipelines declaratively☆92Updated this week
- A Minimalistic Rust Implementation of Delta Sharing Server.☆95Updated 7 months ago
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆10Updated last year
- Apache Arrow Ballista Python bindings☆37Updated last year
- Embeddable Aggregate Management System for Streams and Queries.☆96Updated 6 months ago