Alternatives and similar repositories for spark-flight-connector

Users that are interested in spark-flight-connector are comparing it to the libraries listed below

• rymurr / flight-spark-source
  ☆107Updated 2 years ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆83Updated 8 months ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆20Updated 10 months ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆94Updated 7 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆231Updated last week
• substrait-io / substrait-java
  ☆94Updated this week
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆22Updated last week
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated last year
• snowlift / trino-storage
  Storage connector for Trino
  ☆117Updated 3 weeks ago
• apache / datafusion-ray
  Apache DataFusion Ray
  ☆227Updated 2 months ago
• maropu / spark-sql-flow-plugin
  Visualize column-level data lineage in Spark SQL
  ☆92Updated 3 years ago
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆291Updated last week
• IBM / spark-s3-shuffle
  A S3 Shuffle plugin for Apache Spark to enable elastic scaling for generic Spark workloads.
  ☆50Updated 3 months ago
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆47Updated 5 months ago
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆122Updated this week
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆136Updated 2 years ago
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• dremio-hub / arrow-flight-client-examples
  ☆70Updated 11 months ago
• lakekeeper / console
  A leightweight UI for Lakekeeper
  ☆16Updated this week
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated 10 months ago
• datafusion-contrib / datafusion-java
  Java binding to Apache DataFusion
  ☆83Updated 8 months ago
• manuzhang / awesome-lakehouse
  a curated list of awesome lakehouse frameworks, applications, etc
  ☆37Updated 3 weeks ago
• apache / hudi-rs
  The native Rust implementation for Apache Hudi, with C++ & Python API bindings.
  ☆265Updated this week
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• unitycatalog / unitycatalog-rs
  Open, Multi-modal Catalog for Data & AI, written in Rust
  ☆85Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆130Updated last week
• JanKaul / iceberg-rust
  Unofficial rust implementation of Apache Iceberg with integration for Datafusion
  ☆229Updated this week
• oliverdaff / iceberg-rs
  ☆33Updated 7 months ago
• voltrondata / sqlflite
  An example Flight SQL Server implementation - with DuckDB and SQLite back-ends.
  ☆278Updated last year
• trinodb / benchto
  Framework for running macro benchmarks in a clustered environment
  ☆36Updated 9 months ago