malexer / pytest-spark

Related projects: ⓘ

• danielvdende / data-testing-with-airflow
  ☆195Updated 11 months ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆89Updated 3 years ago
• inspera / blackbricks
  Black for Databricks notebooks
  ☆44Updated last month
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• crflynn / databricks-api
  A simplified, autogenerated API client interface using the databricks-cli package
  ☆60Updated last year
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆53Updated this week
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆115Updated 2 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆66Updated 3 years ago
• databrickslabs / jupyterlab-integration
  DEPRECATED: Integrating Jupyter with Databricks via SSH
  ☆71Updated 2 years ago
• databricks / databricks-sql-cli
  CLI for querying Databricks SQL
  ☆36Updated 9 months ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆192Updated 3 months ago
• ms32035 / airflow-dag-dependencies
  Visualize dependencies between Airflow DAGs
  ☆49Updated 3 years ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated 6 months ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆195Updated 4 years ago
• benchsci / tinsel
  PySpark schema generator
  ☆38Updated last year
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆158Updated 2 weeks ago
• databricks / databricks-sql-python
  Databricks SQL Connector for Python
  ☆153Updated this week
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated last year
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆35Updated 6 months ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆262Updated last year
• snowflakedb / snowflake-ingest-python
  A Python API for Asynchronously Loading Data into Snowflake DB -
  ☆58Updated last week
• capitalone / locopy
  locopy: Loading/Unloading to Redshift and Snowflake using Python.
  ☆104Updated this week
• databrickslabs / dataframe-rules-engine
  Extensible Rules Engine for custom Dataframe / Dataset validation
  ☆134Updated 4 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆161Updated last month
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 3 years ago
• kawadia / pyspark.test
  Example unit tests for Apache Spark Python scripts using the py.test framework
  ☆85Updated 8 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆135Updated last month
• godatadriven / pydantic-spark
  ☆24Updated 6 months ago
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆44Updated 2 years ago
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆134Updated last month