kwai / blaze
Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.
☆1,280Updated this week
Related projects ⓘ
Alternatives and complementary repositories for blaze
- Apache DataFusion Comet Spark Accelerator☆816Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,204Updated this week
- Apache Iceberg☆642Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,531Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,199Updated this week
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆886Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,031Updated this week
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆794Updated 3 weeks ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆381Updated this week
- New file format for storage of large columnar datasets.☆449Updated this week
- Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.☆870Updated this week
- World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.☆1,063Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,503Updated this week
- Lakekeeper: A Rust native Iceberg REST Catalog☆217Updated this week
- LakeSail's computation framework with a mission to unify stream processing, batch processing, and compute-intensive (AI) workloads.☆369Updated this week
- The Feldera Incremental Computation Engine☆720Updated this week
- Scalable, redundant, and distributed object store for Apache Hadoop☆857Updated this week
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆256Updated last year
- A native Rust library for Apache Hudi, with bindings into Python☆144Updated 2 weeks ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆366Updated last week
- Gluten: Plugin to Boost Trino's Performance☆70Updated last year
- Apache DataFusion SQL Query Engine☆6,251Updated this week
- A native Delta implementation for integration with any query engine☆143Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,096Updated this week
- This is the companion repository for the book How Query Engines Work.☆371Updated last year
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆323Updated last year
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆252Updated last year
- A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…☆297Updated 9 months ago
- Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.☆251Updated 5 months ago
- Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch …☆2,408Updated this week