apache / datafusionLinks
Apache DataFusion SQL Query Engine
โ7,844Updated this week
Alternatives and similar repositories for datafusion
Users that are interested in datafusion are comparing it to the libraries listed below
Sorting:
- Official Rust implementation of Apache Arrowโ3,166Updated this week
- ๐๐-๐ก๐ฎ๐๐ถ๐๐ฒ ๐๐ฎ๐๐ฎ ๐ช๐ฎ๐ฟ๐ฒ๐ต๐ผ๐๐๐ฒ. Open-source Snowflake alternative. Proven at petabyte scale with enterprise performance. Bโฆโ8,892Updated last week
- Apache DataFusion Ballista Distributed Query Engineโ1,858Updated this week
- Real-time event streaming platform. Streaming CDC, stream processing, low-latency serving, and Iceberg management.โ8,409Updated this week
- Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.โ6,128Updated this week
- Distributed stream processing engine in Rustโ4,566Updated last week
- Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vโฆโ5,462Updated this week
- A native Rust library for Delta Lake, with bindings into Pythonโ2,965Updated this week
- Apache OpenDAL: One Layer, All Storage.โ4,455Updated last week
- Extensible SQL Lexer and Parser for Rustโ3,206Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.โ3,906Updated this week
- Open-source, cloud-native, unified observability database for metrics, logs and traces, supporting SQL/PromQL/Streaming. Available on Greโฆโ5,565Updated this week
- Apache HoraeDB (incubating) is a high-performance, distributed, cloud native time-series database.โ2,786Updated last month
- Apache Icebergโ1,098Updated last week
- A modular implementation of timely dataflow in Rustโ3,516Updated last week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query processโฆโ1,609Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.โ1,391Updated this week
- Distributed query engine providing simple and reliable data processing for any modality and scaleโ4,546Updated last week
- Apache Icebergโ8,043Updated this week
- A new arguably faster implementation of Apache Spark from scratch in Rustโ2,238Updated 3 years ago
- TensorBase is a new big data warehousing with modern efforts.โ1,454Updated 3 years ago
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analyticsโ16,031Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trโฆโ8,310Updated this week
- Apache DataFusion Comet Spark Acceleratorโ1,048Updated this week
- Fastest library to load data from DB to DataFrames in Rust and Pythonโ2,418Updated last month
- DuckLake is an integrated data lake and catalog formatโ2,101Updated last week
- Transmute-free Rust library to work with the Arrow formatโ1,066Updated last year
- An implementation of differential dataflow using timely dataflow on Rust.โ2,821Updated last week
- GlareDB: A light and fast SQL database for analyticsโ974Updated this week
- Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rustโ13,824Updated this week