Alternatives and similar repositories for spark-flight-connector

Users that are interested in spark-flight-connector are comparing it to the libraries listed below

• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆20Updated 9 months ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆94Updated 6 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated this week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆83Updated 7 months ago
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆47Updated 4 months ago
• maropu / spark-sql-flow-plugin
  Visualize column-level data lineage in Spark SQL
  ☆92Updated 3 years ago
• substrait-io / substrait-java
  ☆94Updated this week
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆22Updated this week
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆291Updated this week
• IBM / spark-s3-shuffle
  A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.
  ☆48Updated 2 months ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆262Updated last week
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆223Updated last month
• snowlift / trino-storage
  Storage connector for Trino
  ☆116Updated last week
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated last year
• lightcopy / parquet-index
  Spark SQL index for Parquet tables
  ☆134Updated 4 years ago
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆122Updated last week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆130Updated 3 weeks ago
• boostscale / velox4j
  Community Java bindings for https://github.com/facebookincubator/velox
  ☆36Updated last week
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆136Updated 2 years ago
• CoxAutomotiveDataSolutions / spark-distcp
  A re-implementation of Hadoop DistCP in Apache Spark
  ☆47Updated last year
• voltrondata / sqlflite
  An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.
  ☆276Updated last year
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆228Updated this week
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆258Updated 2 years ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated last month
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated 10 months ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆187Updated this week
• datafusion-contrib / datafusion-java
  Java binding to Apache DataFusion
  ☆83Updated 7 months ago
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆108Updated 2 years ago