Alternatives and similar repositories for pydantic-spark:

Users that are interested in pydantic-spark are comparing it to the libraries listed below

• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆72Updated this week
• benchsci / tinsel
  PySpark schema generator
  ☆42Updated 2 years ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆183Updated this week
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 6 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆212Updated 3 weeks ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆180Updated last week
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆97Updated last week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆65Updated 6 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆218Updated 5 months ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆46Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆74Updated this week
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• Snowflake-Labs / snowflake-vcrpy
  A PyTest plugin to speed up your tests which depend on Snowflake sessions
  ☆27Updated last year
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated last year
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated 7 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• infinitelambda / dq-tools
  Make simple storing test results and visualisation of these in a BI dashboard
  ☆42Updated this week
• mitodl / ol-data-platform
  Pipeline definitions for managing data flows to power analytics at MIT Open Learning
  ☆43Updated this week
• dbt-labs / dbt-semantic-interfaces
  The shared semantic layer definitions that dbt-core and MetricFlow use.
  ☆76Updated 2 weeks ago
• Divergent-Insights / dbt-dataquality
  Creates simple data models on Snowflake to report dbt source freshness and tests
  ☆24Updated last year
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated 9 months ago
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆31Updated last month
• MrPowers / beavis
  Pandas helper functions
  ☆30Updated 2 years ago
• anna-geller / prefect-dataplatform
  Example repository showing how to build a data platform with Prefect, dbt and Snowflake
  ☆100Updated 2 years ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 3 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆85Updated this week
• delta-incubator / delta-lake-definitive-guide
  ☆33Updated last month
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆27Updated 2 months ago
• jonathanneo / data-aware-orchestration
  Data-aware orchestration with dagster, dbt, and airbyte
  ☆31Updated 2 years ago