MDS-BD / hands-on-great-expectations-with-spark

Related projects ⓘ

Alternatives and complementary repositories for hands-on-great-expectations-with-spark

• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆49Updated 8 months ago
• quby-io / databricks-workflow
  Example of a scalable IoT data processing pipeline setup using Databricks
  ☆31Updated 3 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆22Updated 2 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• delta-io / delta-examples
  Delta Lake examples
  ☆207Updated last month
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 5 months ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆56Updated this week
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆41Updated 4 months ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• sourav-mazumder / Data-Science-Extensions
  ☆71Updated 3 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆22Updated 2 months ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆41Updated 3 months ago
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated 8 months ago
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆15Updated 2 weeks ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆189Updated this week
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• monte-carlo-data / data-observability-in-practice
  Source code for the MC technical blog post "Data Observability in Practice Using SQL"
  ☆36Updated 4 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• saikrishnapujari / Spark-Nested-Data-Parser
  Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark
  ☆15Updated 9 months ago
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆21Updated last month
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last month
• unitycatalog / unitycatalog-ui
  Unity Catalog UI
  ☆39Updated 2 months ago
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆29Updated last month