Alternatives and similar repositories for sparkmon:

Users that are interested in sparkmon are comparing it to the libraries listed below

• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆50Updated 11 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆168Updated last week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆208Updated 2 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆22Updated 4 months ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆65Updated this week
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆101Updated 2 weeks ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆192Updated this week
• delta-incubator / dat
  Delta Acceptance Testing
  ☆20Updated 6 months ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆178Updated last year
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆257Updated 4 months ago
• elsevierlabs-os / NotebookDiscovery
  Notebook Discovery Tool for Databricks notebooks
  ☆19Updated 2 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆79Updated 5 years ago
• logicalclocks / feature-store-api
  Python - Java/Scala API for the Hopsworks feature store
  ☆54Updated this week
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 9 months ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆195Updated 4 years ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆43Updated last year
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆113Updated 10 months ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 4 years ago
• delta-incubator / deltatorch
  ☆54Updated last year
• zheyuan28 / SparkTaskMetrics
  Task Metrics Explorer
  ☆13Updated 5 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆86Updated 9 months ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago
• SemyonSinchenko / spark-connect-example
  An example of SparkConnect extension.
  ☆11Updated 10 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated 7 months ago
• swan-cern / sparkmonitor
  An extension for Jupyter Lab & Jupyter Notebook to monitor Apache Spark (pyspark) from notebooks
  ☆49Updated last year
• sbakiu / kubeflow-spark
  Orchestrate Spark Jobs from Kubeflow Pipelines and poll for the status.
  ☆52Updated 2 years ago
• data-engineering-helpers / data-contracts
  Food for thoughts around data contracts
  ☆24Updated 3 weeks ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago