Alternatives and similar repositories for SparkFlightSql

Users that are interested in SparkFlightSql are comparing it to the libraries listed below

• rymurr / flight-spark-source
  ☆106Updated 2 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆91Updated 3 months ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated last year
• qwshen / spark-flight-connector
  A Spark Connector that reads data from / writes data to Arrow-Flight end-points with Arrow-Flight and Flight-SQL
  ☆42Updated 10 months ago
• AbsaOSS / atum
  A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
  ☆29Updated 9 months ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆45Updated 3 weeks ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 7 months ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated last week
• ing-bank / scruid
  Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.
  ☆115Updated 4 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆106Updated 10 months ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated 2 years ago
• chitralverma / scala-polars
  Polars for Scala & Java projects!
  ☆90Updated last month
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆20Updated 6 months ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 7 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆228Updated 3 weeks ago
• qubole / spark-acid
  ACID Data Source for Apache Spark based on Hive ACID
  ☆97Updated 4 years ago
• chermenin / spark-states
  Custom state store providers for Apache Spark
  ☆92Updated 5 months ago
• squito / spark-memory
  A tool to get better debug info on spark's memory usage
  ☆42Updated 5 years ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆124Updated last week
• swoop-inc / spark-records
  Bulletproof Apache Spark jobs with fast root cause analysis of failures.
  ☆73Updated 4 years ago
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆30Updated last year
• linkedin / Hoptimator
  Multi-hop declarative data pipelines
  ☆117Updated this week
• 10xfuturetechnologies / kafka-connect-iceberg
  Kafka Connector for Iceberg tables
  ☆16Updated 2 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• streamnative / pulsar-spark
  Spark Connector to read and write with Pulsar
  ☆115Updated last month
• sutugin / spark-streaming-jdbc-source
  ☆26Updated 4 years ago
• scalapb / sparksql-scalapb
  SparkSQL utils for ScalaPB
  ☆43Updated 2 months ago
• oliverdaff / iceberg-rs
  ☆33Updated 3 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆227Updated last week
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated 2 weeks ago