Alternatives and similar repositories for spark-flight-connector

Users that are interested in spark-flight-connector are comparing it to the libraries listed below

• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆83Updated 6 months ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆20Updated 9 months ago
• substrait-io / substrait-java
  ☆93Updated this week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated last week
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆22Updated last month
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆292Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆222Updated last month
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆47Updated 3 months ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆94Updated 6 months ago
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated 2 years ago
• maropu / spark-sql-flow-plugin
  Visualize column-level data lineage in Spark SQL
  ☆92Updated 3 years ago
• snowlift / trino-storage
  Storage connector for Trino
  ☆116Updated last week
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆258Updated last week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆130Updated this week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆83Updated last year
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆122Updated this week
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated last year
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆226Updated last week
• datafusion-contrib / datafusion-java
  Java binding to Apache DataFusion
  ☆83Updated 6 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆115Updated 5 months ago
• lakekeeper / console
  A leightweight UI for Lakekeeper
  ☆15Updated this week
• Kimahriman / hdfs-native
  ☆59Updated 3 weeks ago
• dremio-hub / arrow-flight-client-examples
  ☆70Updated 10 months ago
• IBM / spark-s3-shuffle
  A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.
  ☆48Updated last month
• oliverdaff / iceberg-rs
  ☆33Updated 6 months ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆417Updated 6 months ago
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆134Updated 4 years ago