apache / datafusion-comet

Related projects ⓘ

Alternatives and complementary repositories for datafusion-comet

• kwai / blaze
  Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.
  ☆1,292Updated this week
• apache / datafusion-ballista
  Apache DataFusion Ballista Distributed Query Engine
  ☆1,549Updated this week
• apache / iceberg-rust
  Apache Iceberg
  ☆658Updated this week
• substrait-io / substrait
  A cross platform way to express data transformation, relational algebra, standardized record expression and plans.
  ☆1,205Updated this week
• apache / incubator-gluten
  Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
  ☆1,212Updated this week
• projectnessie / nessie
  Nessie: Transactional Catalog for Data Lakes with Git-like semantics
  ☆1,040Updated this week
• lakekeeper / lakekeeper
  Lakekeeper: A Rust native Iceberg REST Catalog
  ☆234Updated this week
• apache / iceberg-python
  Apache PyIceberg
  ☆473Updated this week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆369Updated last week
• facebookincubator / nimble
  New file format for storage of large columnar datasets.
  ☆453Updated last week
• linkedin / coral
  Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.
  ☆795Updated this week
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆144Updated this week
• apache / arrow-adbc
  Database connectivity API standard and libraries for Apache Arrow
  ☆384Updated this week
• apache / polaris
  Apache Polaris, the interoperable, open source catalog for Apache Iceberg
  ☆1,158Updated this week
• apache / datafusion-python
  Apache DataFusion Python Bindings
  ☆375Updated this week
• apache / hudi-rs
  A native Rust library for Apache Hudi, with bindings into Python
  ☆146Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆116Updated this week
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆239Updated last month
• lakehq / sail
  LakeSail's computation framework with a mission to unify stream processing, batch processing, and compute-intensive (AI) workloads.
  ☆375Updated this week
• GlareDB / glaredb
  GlareDB: An analytics DBMS for distributed data
  ☆701Updated this week
• feldera / feldera
  The Feldera Incremental Computation Engine
  ☆768Updated this week
• cmu-db / optd
  CMU-DB's Cascades optimizer framework
  ☆373Updated this week
• delta-io / delta-sharing
  An open protocol for secure data sharing
  ☆770Updated last week
• uber / RemoteShuffleService
  Remote shuffle service for Apache Spark to store shuffle data on remote servers.
  ☆323Updated last year
• duckdb / duckdb_iceberg
  ☆159Updated last month
• rewrite-bigdata-in-rust / RBIR
  A collection of RBIR projects and posts for anyone interested in joining this journey.
  ☆174Updated this week
• andygrove / how-query-engines-work
  This is the companion repository for the book How Query Engines Work.
  ☆373Updated last year
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆312Updated this week