apache / datafusion-cometLinks
Apache DataFusion Comet Spark Accelerator
☆1,105Updated this week
Alternatives and similar repositories for datafusion-comet
Users that are interested in datafusion-comet are comparing it to the libraries listed below
Sorting:
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,684Updated this week
- Apache Iceberg☆1,193Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,454Updated this week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,152Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,945Updated last week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,495Updated last week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,399Updated this week
- New file format for storage of large columnar datasets.☆676Updated this week
- A native Delta implementation for integration with any query engine☆308Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆267Updated last week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆426Updated 8 months ago
- Apache DataFusion Ray☆228Updated 3 months ago
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,808Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,123Updated this week
- PyIceberg☆978Updated this week
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆882Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆307Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆535Updated this week
- ☆369Updated this week
- Drop-in replacement for Apache Spark UI☆393Updated this week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆232Updated last week
- Apache DataFusion Python Bindings☆550Updated last week
- Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).☆20Updated 11 months ago
- GlareDB: A light and fast SQL database for analytics☆993Updated 2 months ago
- Open Control Plane for Tables in Data Lakehouse☆377Updated last week
- ☆240Updated this week
- TPC-H benchmark data generation in pure Rust☆221Updated last week
- This is the companion repository for the book How Query Engines Work.☆420Updated 3 weeks ago
- LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…☆88Updated 2 months ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆440Updated this week