apache / datafusionLinks
Apache DataFusion SQL Query Engine
☆8,234Updated this week
Alternatives and similar repositories for datafusion
Users that are interested in datafusion are comparing it to the libraries listed below
Sorting:
- Official Rust implementation of Apache Arrow☆3,301Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,934Updated 2 weeks ago
- One Warehouse for Analytics, Search, AI. Snowflake + Elasticsearch + Vector DB — rebuilt from scratch. Unified architecture on your S3.☆9,071Updated last week
- Event streaming platform for agents, apps, and analytics. Continuously ingest, transform, and serve event data in real time, at scale.☆8,652Updated this week
- Distributed stream processing engine in Rust☆4,746Updated 2 weeks ago
- A native Rust library for Delta Lake, with bindings into Python☆3,084Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆5,884Updated last week
- Apache OpenDAL: One Layer, All Storage.☆4,794Updated last week
- The live data layer for apps and AI agents Create up-to-the-second views into your business, just using SQL☆6,199Updated this week
- Extensible SQL Lexer and Parser for Rust☆3,278Updated last week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,001Updated this week
- Open-source, cloud-native, unified observability database for metrics, logs and traces, supporting SQL/PromQL/Streaming.☆5,870Updated last week
- Apache Iceberg☆1,182Updated last week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,443Updated 2 weeks ago
- A modular implementation of timely dataflow in Rust☆3,557Updated last month
- Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics☆16,341Updated this week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,675Updated this week
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Li…☆2,432Updated this week
- A new arguably faster implementation of Apache Spark from scratch in Rust☆2,239Updated 3 years ago
- Apache HoraeDB (incubating) is a high-performance, distributed, cloud native time-series database.☆2,814Updated 3 weeks ago
- Transmute-free Rust library to work with the Arrow format☆1,067Updated last year
- TensorBase is a new big data warehousing with modern efforts.☆1,459Updated 3 years ago
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,085Updated this week
- Build Postgres Extensions with Rust!☆4,313Updated last week
- Apache Iceberg☆8,383Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,512Updated this week
- Apache DataFusion Comet Spark Accelerator☆1,096Updated this week
- Tantivy is a full-text search engine library inspired by Apache Lucene and written in Rust☆14,241Updated last week
- Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.☆10,740Updated this week
- An implementation of differential dataflow using timely dataflow on Rust.☆2,887Updated last month