Alternatives and similar repositories for pydantic-spark

Users that are interested in pydantic-spark are comparing it to the libraries listed below

• benchsci / tinsel
  PySpark schema generator
  ☆42Updated 2 years ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆93Updated this week
• Snowflake-Labs / snowflake-vcrpy
  A PyTest plugin to speed up your tests which depend on Snowflake sessions
  ☆27Updated last week
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 8 months ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 10 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆50Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆216Updated 3 weeks ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆192Updated this week
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆47Updated last year
• delta-io / delta-examples
  Delta Lake examples
  ☆225Updated 8 months ago
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆101Updated this week
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆168Updated last year
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated 2 weeks ago
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated 2 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated last week
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆23Updated last year
• castor-team / airflow-castor
  ☆43Updated 3 years ago
• shabbirk-db / streaming-dbt
  Streaming demo dbt
  ☆17Updated 8 months ago
• dbt-labs / dbt-meshify
  A dbt-core python package that automates the management and creation of dbt groups, contracts, access, and versions.
  ☆121Updated 4 months ago
• coiled / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated 6 months ago
• kgmcquate / dbt-testgen
  Generate DBT tests based on sample data
  ☆36Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• louisguitton / dbt-metadata-utils
  Parse dbt artifacts and search dbt models with Algolia
  ☆52Updated 4 years ago
• sparkdq-community / sparkdq
  A declarative PySpark framework for row- and aggregate-level data quality validation.
  ☆46Updated this week
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆148Updated this week
• yu-iskw / dbt-artifacts-parser
  A dbt artifacts parser in python
  ☆93Updated this week
• stkbailey / dagster-jaffle-shop
  Repo for orienting dbt users to the Dagster asset framework
  ☆54Updated 2 years ago
• franloza / coches-net-dashboard
  Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market
  ☆57Updated 2 years ago