Alternatives and similar repositories for spark-connect-example

Users that are interested in spark-connect-example are comparing it to the libraries listed below

• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆53Updated last month
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated last week
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆259Updated 8 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆224Updated 2 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆216Updated 3 weeks ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last month
• voltrondata / spark-substrait-gateway
  Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
  ☆19Updated 3 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated this week
• dataflint / spark
  A modern replacement Apache Spark UI
  ☆259Updated this week
• delta-io / website
  Delta Lake Website
  ☆25Updated 2 weeks ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 8 months ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆235Updated 10 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆326Updated 9 months ago
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆48Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 10 months ago
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆23Updated 11 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆95Updated last year
• hussein-awala / spark-on-k8s
  A Python package to submit and manage Apache Spark applications on Kubernetes.
  ☆41Updated 2 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 8 months ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last month
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆404Updated this week
• zeotap / spark-property-tests
  Write property based tests easily on spark dataframes
  ☆19Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆125Updated 2 weeks ago
• owenrh / spark-fires
  Spark fires is a anti-pattern playground where we deliberately break Spark applications in various ways so you can observe what happens a…
  ☆42Updated 6 months ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆344Updated last year
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 4 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated 3 weeks ago