apache / datafusionLinks
Apache DataFusion SQL Query Engine
☆7,628Updated last week
Alternatives and similar repositories for datafusion
Users that are interested in datafusion are comparing it to the libraries listed below
Sorting:
- Official Rust implementation of Apache Arrow☆3,097Updated last week
- Apache DataFusion Ballista Distributed Query Engine☆1,821Updated last week
- Real-time event streaming platform. Streaming CDC, stream processing, low-latency serving, and Iceberg management.☆8,274Updated this week
- Apache OpenDAL: One Layer, All Storage.☆4,368Updated this week
- Distributed stream processing engine in Rust☆4,476Updated last week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, v…☆5,227Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.☆6,082Updated this week
- 𝗔𝗜-𝗡𝗮𝘁𝗶𝘃𝗲 𝗗𝗮𝘁𝗮 𝗪𝗮𝗿𝗲𝗵𝗼𝘂𝘀𝗲. Open-source Snowflake alternative. Proven at petabyte scale with enterprise performance. B…☆8,736Updated this week
- Extensible SQL Lexer and Parser for Rust☆3,165Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,904Updated this week
- Open-source, cloud-native, unified observability database for metrics, logs and traces, supporting SQL/PromQL/Streaming. Available on Gre…☆5,465Updated this week
- A modular implementation of timely dataflow in Rust☆3,489Updated last week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,861Updated this week
- Apache Iceberg☆1,059Updated this week
- Apache HoraeDB (incubating) is a high-performance, distributed, cloud native time-series database.☆2,771Updated 2 months ago
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,528Updated this week
- Build Postgres Extensions with Rust!☆4,123Updated 3 weeks ago
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,368Updated last week
- A new arguably faster implementation of Apache Spark from scratch in Rust☆2,238Updated 3 years ago
- Distributed query engine providing simple and reliable data processing for any modality and scale☆3,280Updated this week
- An implementation of differential dataflow using timely dataflow on Rust.☆2,787Updated this week
- TensorBase is a new big data warehousing with modern efforts.☆1,453Updated 3 years ago
- Apache Iceberg☆7,855Updated this week
- Apache DataFusion Comet Spark Accelerator☆1,028Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Python☆2,388Updated this week
- Transmute-free Rust library to work with the Arrow format☆1,062Updated last year
- High-performance runtime for data analytics applications☆3,002Updated 3 years ago
- An embedded key-value database in pure Rust☆3,917Updated 2 weeks ago
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,215Updated last week
- Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.☆10,336Updated last week