Alternatives and similar repositories for data-pipelines-in-rust

Users that are interested in data-pipelines-in-rust are comparing it to the libraries listed below

• PowerSQL / PowerSQL
  Robust data transformation tool using SQL
  ☆22Updated 2 years ago
• lancedb / tantivy-object-store
  Tantivy directory implementation backed by object_store
  ☆37Updated last year
• datafusion-contrib / datafusion-catalogprovider-glue
  ☆21Updated last year
• datafusion-contrib / datafusion-streams
  ☆23Updated 3 years ago
• datafusion-contrib / datafusion-objectstore-s3
  S3 as an ObjectStore for DataFusion
  ☆66Updated 2 years ago
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆84Updated last year
• pacman82 / arrow-odbc
  Fill Apache Arrow record batches from an ODBC data source in Rust.
  ☆74Updated 3 weeks ago
• sal-openlab / datafusion-server
  Rust DataFusion Server
  ☆23Updated 2 weeks ago
• pola-rs / polars-benchmark
  ☆116Updated last month
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago
• datafusion-contrib / datafusion-dft
  Batteries included CLI, TUI, and server implementations for DataFusion.
  ☆177Updated last week
• substrait-io / substrait-rs
  Rust crate for Substrait: Cross-Language Serialization for Relational Algebra
  ☆80Updated last week
• datafusion-contrib / datafusion-functions-json
  JSON support for DataFusion (unofficial)
  ☆48Updated last week
• datafusion-contrib / datafusion-postgres
  Postgres protocol frontend for DataFusion
  ☆108Updated this week
• delta-incubator / delta-sharing-rs
  A Minimalistic Rust Implementation of Delta Sharing Server.
  ☆95Updated 8 months ago
• coriolinus / 1brc
  How fast can we do simple math on 1 billion rows of input?
  ☆40Updated last year
• datafusion-contrib / datafusion-substrait
  Experimental support for serializing DataFusion plans using substrait
  ☆46Updated 2 years ago
• wdoppenberg / polars-candle
  A text embedding extension for the Polars Dataframe library.
  ☆26Updated 11 months ago
• vigimite / aqueducts
  Framework to build data pipelines declaratively
  ☆92Updated 3 weeks ago
• Eventual-Inc / daft-cli
  A cli for spinning up and managing Ray clusters for the Daft Query Engine.
  ☆14Updated 9 months ago
• second-state / MEGA
  Make ETLs Great Again!
  ☆43Updated 2 years ago
• databendcloud / dbt-databend
  dbt-databend adapter plugin
  ☆10Updated last year
• datafusion-contrib / datafusion-federation
  Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.
  ☆155Updated 3 weeks ago
• oliverdaff / iceberg-rs
  ☆33Updated 6 months ago
• uwheel / uwheel
  Embeddable Aggregate Management System for Streams and Queries.
  ☆99Updated last week
• andrewleverette / data_wrangling_with_rust
  A series of articles that explore working with data using Datafusion and Apache Arrow.
  ☆10Updated 4 years ago
• jhoekx / python-rust-arrow-interop-example
  Example of using the Apache Arrow C Data Interface between Python and Rust
  ☆24Updated last year
• psila-ai / callysto
  Stream processing & Service framework.
  ☆159Updated last year
• qdrant / wal
  Write Ahead Logging for Rust
  ☆33Updated last month
• nooberfsh / prusto
  A presto/trino client library written in rust.
  ☆43Updated 10 months ago