Alternatives and similar repositories for hands-on-great-expectations-with-spark

Users that are interested in hands-on-great-expectations-with-spark are comparing it to the libraries listed below

• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated 2 weeks ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 8 months ago
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated 2 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated 10 months ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆22Updated 3 years ago
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆75Updated 3 years ago
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆27Updated last week
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 9 months ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆96Updated this week
• MrPowers / spark-stringmetric
  Spark functions to run popular phonetic and string matching algorithms
  ☆60Updated 3 years ago
• delta-incubator / deltatorch
  ☆58Updated last year
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated last month
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 9 months ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• StabRise / spark-pdf
  PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it
  ☆69Updated 2 months ago
• quby-io / databricks-workflow
  Example of a scalable IoT data processing pipeline setup using Databricks
  ☆32Updated 4 years ago
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆21Updated last year
• benchsci / tinsel
  PySpark schema generator
  ☆43Updated 2 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆326Updated 9 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆259Updated 8 months ago
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆48Updated last year
• tupol / spark-utils
  Basic framework utilities to quickly start writing production ready Apache Spark applications
  ☆36Updated 6 months ago