Alternatives and similar repositories for marshmallow-pyspark:

Users that are interested in marshmallow-pyspark are comparing it to the libraries listed below

• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆212Updated last week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆322Updated 6 months ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆676Updated 3 weeks ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆180Updated 2 weeks ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆221Updated last week
• delta-io / delta-examples
  Delta Lake examples
  ☆221Updated 5 months ago
• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆42Updated this week
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆667Updated 3 weeks ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 6 months ago
• tomasfarias / airflow-dbt-python
  A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  ☆194Updated last month
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆240Updated last month
• paiqo / Databricks-VSCode
  VSCode extension to work with Databricks
  ☆127Updated 3 weeks ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆33Updated 4 years ago
• souvik-databricks / dlt-with-debug
  A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT …
  ☆49Updated 2 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• alexott / databricks-playground
  Code samples, etc. for Databricks
  ☆63Updated 2 weeks ago
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆424Updated last month
• castor-team / airflow-castor
  ☆43Updated 3 years ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆65Updated 6 months ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆345Updated 10 months ago
• greatexpectationslabs / put-data-pipeline-under-test-with-pytest-and-great-expectations
  How to write integration tests for data pipelines using Great Expectations and pytest.
  ☆16Updated 6 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 6 months ago
• mrchristine / db-migration
  Databricks Migration Tools
  ☆43Updated 3 years ago
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆161Updated last week
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆167Updated last year
• littleK0i / SnowDDL
  Declarative database change management tool for Snowflake
  ☆119Updated last week
• danielvdende / data-testing-with-airflow
  ☆198Updated last year
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆146Updated last week
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆75Updated this week