Alternatives and similar repositories for pbspark:

Users that are interested in pbspark are comparing it to the libraries listed below

• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 6 months ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 2 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆179Updated this week
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆27Updated 2 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆221Updated 2 weeks ago
• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆42Updated last week
• zheyuan28 / SparkTaskMetrics
  Task Metrics Explorer
  ☆13Updated 6 years ago
• robert-altmiller / code_profiler
  ☆16Updated 5 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆212Updated this week
• justhackit / spark-utils
  ☆10Updated 2 years ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆81Updated this week
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 4 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 6 months ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 9 months ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 3 months ago
• GoogleCloudPlatform / oozie-to-airflow
  Oozie Workflow to Airflow DAGs migration tool
  ☆87Updated last month
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 6 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆221Updated 6 months ago
• japila-books / pyspark-internals
  The Internals of PySpark
  ☆26Updated 3 months ago
• HeartSaVioR / spark-state-tools
  Spark Structured Streaming State Tools
  ☆34Updated 4 years ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆222Updated 4 months ago
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆23Updated 9 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 7 months ago
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆48Updated last year
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆20Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year