Alternatives and similar repositories for flight-spark-source:

Users that are interested in flight-spark-source are comparing it to the libraries listed below

• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆39Updated 7 months ago
• substrait-io / substrait-java
  ☆85Updated last week
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆89Updated last year
• BryanCutler / SparkArrowFlight
  Example for simple Apache Arrow Flight service with Apache Spark and TensorFlow clients
  ☆36Updated 4 years ago
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆29Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated last month
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆46Updated 3 months ago
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆18Updated 2 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 4 months ago
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆72Updated 4 years ago
• datafusion-contrib / datafusion-java
  Java binding to Apache DataFusion
  ☆79Updated 3 weeks ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆183Updated 3 months ago
• ibm-research-ireland / sparkoscope
  Enabling Spark Optimization through Cross-stack Monitoring and Visualization
  ☆47Updated 7 years ago
• apache / datasketches
  Apache datasketches
  ☆95Updated 2 years ago
• apache / datafusion-benchmarks
  Apache DataFusion Benchmarks
  ☆18Updated last month
• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• tokoko / SparkFlightSql
  ☆10Updated 2 years ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆77Updated 3 weeks ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆61Updated 5 months ago
• qubole / rubix
  Cache File System optimized for columnar formats and object stores
  ☆182Updated 2 years ago
• oap-project / remote-shuffle
  Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…
  ☆21Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 7 months ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• ibis-project / ibis-substrait
  Ibis Substrait Compiler
  ☆102Updated this week
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• spirom / spark-data-sources
  Developing Spark External Data Sources using the V2 API
  ☆47Updated 7 years ago
• substrait-io / duckdb-substrait-extension
  ☆40Updated 3 weeks ago
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆257Updated 2 years ago