Alternatives and similar repositories for pytest-spark:

Users that are interested in pytest-spark are comparing it to the libraries listed below

• danielvdende / data-testing-with-airflow
  ☆198Updated last year
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆116Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆160Updated this week
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆93Updated 4 years ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆197Updated 2 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆174Updated last week
• inspera / blackbricks
  Black for Databricks notebooks
  ☆44Updated last month
• capitalone / locopy
  locopy: Loading/Unloading to Redshift and Snowflake using Python.
  ☆106Updated this week
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆136Updated 7 months ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆76Updated 6 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆138Updated last month
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆84Updated 8 years ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆205Updated this week
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆65Updated 4 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆94Updated 6 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆195Updated 5 years ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆70Updated this week
• alexott / spark-playground
  Playing with different packages of the Apache Spark
  ☆28Updated 8 months ago
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆145Updated this week
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆256Updated 2 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆45Updated 11 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 5 months ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆662Updated this week
• benchsci / tinsel
  PySpark schema generator
  ☆41Updated 2 years ago
• crflynn / databricks-api
  A simplified, autogenerated API client interface using the databricks-cli package
  ☆61Updated last year
• mastak / airflow_multi_dagrun
  triggering a DAG run multiple times
  ☆87Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆214Updated this week
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆106Updated 9 months ago