Alternatives and similar repositories for spark-substrait-gateway

Users that are interested in spark-substrait-gateway are comparing it to the libraries listed below

• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆41Updated 9 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆79Updated 3 months ago
• duckdb / duckdb-iceberg
  ☆295Updated this week
• apache / datafusion-comet
  Apache DataFusion Comet Spark Accelerator
  ☆993Updated this week
• velox4j / velox4j
  Java bindings for https://github.com/facebookincubator/velox
  ☆29Updated this week
• oap-project / Gluten-Trino
  Gluten: Plugin to Boost Trino's Performance
  ☆73Updated last year
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆236Updated this week
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆47Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆209Updated 3 months ago
• microsoft / lst-bench
  LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as De…
  ☆77Updated this week
• snowlift / trino-storage
  Storage connector for Trino
  ☆112Updated this week
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆20Updated 3 months ago
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆271Updated last week
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• substrait-io / substrait-java
  ☆86Updated this week
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆257Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆227Updated this week
• uber / RemoteShuffleService
  Remote shuffle service for Apache Spark to store shuffle data on remote servers.
  ☆327Updated last year
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆274Updated 2 weeks ago
• lakekeeper / lakekeeper
  Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.
  ☆779Updated this week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆125Updated last month
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated 2 months ago
• lancedb / lance-namespace
  Lance Namespace Specification is an open specification on top of the storage-based Lance data format to standardize access to a collectio…
  ☆23Updated this week
• rymurr / flight-spark-source
  ☆106Updated 2 years ago
• IBM / spark-s3-shuffle
  A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.
  ☆45Updated 2 months ago
• linkedin / transport
  A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…
  ☆299Updated last year
• kevinjqliu / iceberg-rest-catalog
  Pythonic Iceberg REST Catalog
  ☆2Updated 3 weeks ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆233Updated this week
• facebookincubator / nimble
  New file format for storage of large columnar datasets.
  ☆575Updated this week
• voltrondata / sqlflite
  An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.
  ☆259Updated 9 months ago