Alternatives and similar repositories for pydantic-spark

Users that are interested in pydantic-spark are comparing it to the libraries listed below

• benchsci / tinsel
  PySpark schema generator
  ☆42Updated 2 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 8 months ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆88Updated this week
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆99Updated this week
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆215Updated last week
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 10 months ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆188Updated this week
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated 2 years ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆113Updated last year
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated last month
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated last week
• tekumara / fakesnow
  Run, mock and test fake Snowflake databases locally.
  ☆131Updated 2 weeks ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆46Updated last year
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• godatadriven / pydantic-avro
  This library can convert a pydantic class to a avro schema or generate python code from a avro schema.
  ☆73Updated last month
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆50Updated last year
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated 10 months ago
• jonathanneo / data-aware-orchestration
  Data-aware orchestration with dagster, dbt, and airbyte
  ☆31Updated 2 years ago
• anna-geller / prefect-dataplatform
  Example repository showing how to build a data platform with Prefect, dbt and Snowflake
  ☆101Updated 2 years ago
• developer-advocacy-dremio / quick-guides-from-dremio
  Quick Guides from Dremio on Several topics
  ☆71Updated 4 months ago
• infinitelambda / dq-tools
  Make simple storing test results and visualisation of these in a BI dashboard
  ☆44Updated last month
• delta-io / delta-examples
  Delta Lake examples
  ☆224Updated 7 months ago
• Snowflake-Labs / snowflake-vcrpy
  A PyTest plugin to speed up your tests which depend on Snowflake sessions
  ☆27Updated last year
• godatadriven / airflow-testing-examples
  ☆50Updated 4 years ago
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆27Updated 4 months ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆168Updated last year
• dagster-io / project-dagster-university
  Dagster University courses
  ☆82Updated this week
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆47Updated 2 years ago