apache / datafusion-cometLinks
Apache DataFusion Comet Spark Accelerator
☆988Updated this week
Alternatives and similar repositories for datafusion-comet
Users that are interested in datafusion-comet are comparing it to the libraries listed below
Sorting:
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,493Updated last week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆779Updated this week
- Apache Iceberg☆1,014Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,793Updated last week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,355Updated 3 weeks ago
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,252Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,384Updated this week
- A native Delta implementation for integration with any query engine☆236Updated this week
- New file format for storage of large columnar datasets.☆567Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆230Updated last week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,580Updated this week
- Apache PyIceberg☆805Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆408Updated 2 months ago
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆824Updated last week
- Apache DataFusion Ray☆209Updated 3 months ago
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆843Updated last month
- ☆291Updated last week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆259Updated last week
- Gluten: Plugin to Boost Trino's Performance☆73Updated last year
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆19Updated 5 months ago
- Apache DataFusion Python Bindings☆464Updated last week
- Database connectivity API standard and libraries for Apache Arrow☆470Updated this week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆205Updated this week
- Distributed SQL Query Engine in Python using Ray☆243Updated 9 months ago
- Drop-in replacement for Apache Spark UI☆273Updated 2 weeks ago
- ☆211Updated last week
- Open Control Plane for Tables in Data Lakehouse☆359Updated this week
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆271Updated last week
- This is the companion repository for the book How Query Engines Work.☆394Updated 2 years ago
- An open protocol for secure data sharing☆851Updated 3 weeks ago