Alternatives and similar repositories for spark-flight-connector

Users that are interested in spark-flight-connector are comparing it to the libraries listed below

• rymurr / flight-spark-source
  ☆106Updated 2 years ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆20Updated 5 months ago
• substrait-io / substrait-java
  ☆86Updated this week
• datafusion-contrib / datafusion-java
  Java binding to Apache DataFusion
  ☆82Updated 3 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆80Updated 3 months ago
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆214Updated 4 months ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆239Updated last week
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆91Updated 2 months ago
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆47Updated 2 weeks ago
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆207Updated this week
• sjrusso8 / spark-connect-rs
  Apache Spark Connect Client for Rust
  ☆110Updated last month
• oliverdaff / iceberg-rs
  ☆33Updated 2 months ago
• Kimahriman / hdfs-native
  ☆54Updated last week
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆81Updated 10 months ago
• apache / paimon-rust
  Apache Paimon Rust The rust implementation of Apache Paimon.
  ☆129Updated 3 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆228Updated last week
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆244Updated 10 months ago
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆257Updated 2 years ago
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆20Updated 3 months ago
• apache / datasketches
  Apache datasketches
  ☆97Updated 2 years ago
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated last year
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆275Updated this week
• onehouseinc / LakeView
  Monitoring and insights on your data lakehouse tables
  ☆31Updated last week
• delta-io / delta-kernel-rs
  A native Delta implementation for integration with any query engine
  ☆238Updated this week
• CoxAutomotiveDataSolutions / spark-distcp
  A re-implementation of Hadoop DistCP in Apache Spark
  ☆47Updated last year
• nimtable / iceberg-compaction
  Comptaction runtime for Apache Iceberg.
  ☆58Updated last week
• dremio-hub / arrow-flight-client-examples
  ☆70Updated 6 months ago
• maropu / spark-sql-flow-plugin
  Visualize column-level data lineage in Spark SQL
  ☆92Updated 3 years ago
• snowlift / trino-storage
  Storage connector for Trino
  ☆112Updated 2 weeks ago