apache / datafusion-comet
Apache DataFusion Comet Spark Accelerator
☆879Updated this week
Alternatives and similar repositories for datafusion-comet:
Users that are interested in datafusion-comet are comparing it to the libraries listed below
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,387Updated this week
- Apache Iceberg☆789Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,242Updated this week
- Lakekeeper: A Rust native Iceberg REST Catalog☆406Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,111Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,631Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,255Updated this week
- Apache PyIceberg☆568Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆385Updated this week
- New file format for storage of large columnar datasets.☆473Updated this week
- A native Delta implementation for integration with any query engine☆179Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,296Updated this week
- The native Rust implementation for Apache Hudi, with Python API bindings.☆187Updated this week
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆818Updated 2 months ago
- Apache DataFusion Python Bindings☆405Updated last week
- Open Control Plane for Tables in Data Lakehouse☆321Updated last week
- Distributed SQL Query Engine in Python using Ray☆242Updated 3 months ago
- Apache DataFusion Ray☆150Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive (AI) workloads.☆624Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆397Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆215Updated this week
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆923Updated this week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆398Updated this week
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆219Updated this week
- This is the companion repository for the book How Query Engines Work.☆379Updated last year
- A native Rust library for Delta Lake, with bindings into Python☆2,512Updated this week
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆722Updated last week
- ☆176Updated this week
- ☆199Updated this week
- Rust implementation of Apache Iceberg with integration for Datafusion☆135Updated this week