Alternatives and similar repositories for spark-flight-connector

Users that are interested in spark-flight-connector are comparing it to the libraries listed below

• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆20Updated 11 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆83Updated 9 months ago
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆24Updated last month
• substrait-io / substrait-java
  ☆97Updated this week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆229Updated 3 months ago
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆296Updated this week
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆47Updated 6 months ago
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆124Updated last week
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆268Updated this week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated last week
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆94Updated 8 months ago
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆232Updated 2 weeks ago
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆136Updated 2 years ago
• maropu / spark-sql-flow-plugin
  Visualize column-level data lineage in Spark SQL
  ☆92Updated 3 years ago
• dremio-hub / arrow-flight-client-examples
  ☆70Updated last year
• IBM / spark-s3-shuffle
  A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.
  ☆50Updated 4 months ago
• datafusion-contrib / datafusion-java
  Java binding to Apache DataFusion
  ☆83Updated 9 months ago
• snowlift / trino-storage
  Storage connector for Trino
  ☆117Updated last week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆86Updated last year
• voltrondata / sqlflite
  An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.
  ☆280Updated last year
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated 2 years ago
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆246Updated last year
• lakekeeper / console
  A leightweight UI for Lakekeeper
  ☆16Updated last week
• duckdb / duckdb-iceberg
  ☆374Updated this week
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 3 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated last year
• nimtable / iceberg-compaction
  Compaction runtime for Apache Iceberg.
  ☆114Updated this week
• CoxAutomotiveDataSolutions / spark-distcp
  A re-implementation of Hadoop DistCP in Apache Spark
  ☆47Updated 2 years ago
• oliverdaff / iceberg-rs
  ☆33Updated 8 months ago