Apache DataFusion Comet Spark Accelerator
☆1,142Feb 20, 2026Updated last week
Alternatives and similar repositories for datafusion-comet
Users that are interested in datafusion-comet are comparing it to the libraries listed below
Sorting:
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,715Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,977Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,516Updated this week
- Apache DataFusion SQL Query Engine☆8,428Updated this week
- Apache Iceberg☆1,229Updated this week
- Apache DataFusion Ray☆228Oct 5, 2025Updated 4 months ago
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,174Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,476Updated this week
- Apache DataFusion Python Bindings☆564Updated this week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,196Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,065Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,845Feb 20, 2026Updated last week
- Official Rust implementation of Apache Arrow☆3,373Feb 20, 2026Updated last week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆233Feb 17, 2026Updated last week
- A native Rust library for Delta Lake, with bindings into Python☆3,156Updated this week
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,039Feb 19, 2026Updated last week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆144Feb 12, 2026Updated 2 weeks ago
- Open, Multi-modal Catalog for Data & AI☆3,313Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆6,074Updated this week
- New file format for storage of large columnar datasets.☆693Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆269Updated this week
- Apache Iceberg☆8,572Updated this week
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,250Updated this week
- An extensible, state of the art columnar file format. Formerly at @spiraldb, now an Incubation Stage project at LFAI&Data, part of the Li…☆2,728Updated this week
- Distributed stream processing engine in Rust☆4,823Feb 19, 2026Updated last week
- Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processin…☆1,161Feb 20, 2026Updated last week
- Distributed SQL Query Engine in Python using Ray☆245Oct 2, 2024Updated last year
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,420Updated this week
- GlareDB: A light and fast SQL database for analytics☆1,001Nov 14, 2025Updated 3 months ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆446Feb 12, 2026Updated 2 weeks ago
- Spark RAPIDS plugin - accelerate Apache Spark with GPUs☆963Updated this week
- Embeddable stream processing engine based on Apache DataFusion☆374Dec 18, 2024Updated last year
- CMU-DB's Cascades optimizer framework☆406Jan 6, 2025Updated last year
- Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch …☆3,188Feb 20, 2026Updated last week
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆888Feb 9, 2026Updated 2 weeks ago
- Event streaming platform for agents, apps, and analytics. Continuously ingest, transform, and serve event data in real time, at scale.☆8,819Updated this week
- Pure Rust Iceberg Implementation☆162Aug 13, 2024Updated last year
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,304Updated this week
- Tonbo is an embedded database for serverless and edge runtimes.☆1,497Feb 20, 2026Updated last week