Alternatives and similar repositories for sparkdq

Users that are interested in sparkdq are comparing it to the libraries listed below

• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last month
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• dlt-hub / verified-sources
  Contribute to dlt verified sources 🔥
  ☆87Updated 3 weeks ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆98Updated this week
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆195Updated this week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆255Updated 2 weeks ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆324Updated 10 months ago
• starlake-ai / starlake
  Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
  ☆123Updated this week
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆50Updated last year
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆414Updated this week
• tekumara / fakesnow
  Run, mock and test fake Snowflake databases locally.
  ☆144Updated last week
• boringdata / boring-catalog
  ☆146Updated last month
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆218Updated 2 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 10 months ago
• okube-ai / laktory
  A DataOps framework for building a lakehouse.
  ☆52Updated this week
• sbalnojan / run-a-data-team
  A guide for leading a data (engineering) team
  ☆64Updated last year
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆70Updated 9 months ago
• conveyordata / data-product-portal
  Data product portal created by Dataminded
  ☆186Updated this week
• data-catering / insta-infra
  Quickstart for any service
  ☆156Updated this week
• zsvoboda / ngods
  New generation opensource data stack
  ☆70Updated 3 years ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 3 weeks ago
• slidoapp / duckberg
  Python package for querying iceberg data through duckdb.
  ☆70Updated last year
• delta-io / delta-examples
  Delta Lake examples
  ☆226Updated 9 months ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆47Updated last year
• Spratiher9 / JumpSpark
  JumpSpark - A modern cookiecutter template for pyspark projects with batteries included.
  ☆10Updated 2 years ago
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆254Updated last year
• xorq-labs / xorq
  Catalog, compose, and ship ML—Python simplicity, SQL scale.
  ☆314Updated this week
• DataKitchen / data-observability-installer
  Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …
  ☆121Updated last week
• dagster-io / awesome-dagster
  All things awesome related to Dagster!
  ☆116Updated 3 weeks ago
• ognis1205 / delta-hub
  A platform and cloud-based service for data sharing based on the Delta Sharing protocol.
  ☆21Updated last year