substrait-io / substrait
A cross platform way to express data transformation, relational algebra, standardized record expression and plans.
☆1,238Updated this week
Alternatives and similar repositories for substrait:
Users that are interested in substrait are comparing it to the libraries listed below
- Apache DataFusion Comet Spark Accelerator☆866Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,618Updated this week
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,101Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,249Updated this week
- Database connectivity API standard and libraries for Apache Arrow☆393Updated this week
- Blazing-fast query execution engine speaks Apache Spark language and has Arrow-DataFusion at its core.☆1,373Updated this week
- Apache Iceberg☆778Updated this week
- Lakekeeper: A Rust native Iceberg REST Catalog☆377Updated this week
- New file format for storage of large columnar datasets.☆464Updated this week
- Apache DataFusion Python Bindings☆400Updated this week
- Apache PyIceberg☆551Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆3,586Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆2,483Updated this week
- Making data lake work for time series☆1,147Updated 4 months ago
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,276Updated this week
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆811Updated 2 months ago
- An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.☆224Updated 3 months ago
- Apache DataFusion SQL Query Engine☆6,628Updated this week
- Apache Parquet Format☆1,851Updated this week
- Distributed SQL Query Engine in Python using Ray☆240Updated 3 months ago
- A native Delta implementation for integration with any query engine☆174Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆379Updated this week
- Distributed SQL Engine in Python using Dask☆396Updated 4 months ago
- Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg☆315Updated last year
- Vectorized processing for Apache Arrow☆484Updated 2 years ago
- This is the companion repository for the book How Query Engines Work.☆376Updated last year
- BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)☆234Updated 8 months ago
- Transmute-free Rust library to work with the Arrow format☆1,063Updated 10 months ago
- CMU-DB's Cascades optimizer framework☆394Updated last week
- An open protocol for secure data sharing☆791Updated 2 weeks ago