Alternatives and similar repositories for check-engine

Users that are interested in check-engine are comparing it to the libraries listed below

• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆175Updated 4 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆263Updated last year
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 6 years ago
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆96Updated 3 weeks ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated last year
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆39Updated last year
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆133Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆87Updated 4 months ago
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆41Updated 6 years ago
• danielvdende / data-testing-with-airflow
  ☆201Updated last year
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆198Updated 5 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆76Updated 4 years ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• holdenk / high-performance-spark-examples
  Examples for High Performance Spark
  ☆16Updated last month
• delta-io / delta-examples
  Delta Lake examples
  ☆228Updated 11 months ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆169Updated last year
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last year
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆159Updated 2 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated this week
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last week
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆260Updated 2 years ago
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 7 years ago