Alternatives and similar repositories for pyspark-cicd-template

Users that are interested in pyspark-cicd-template are comparing it to the libraries listed below

• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 9 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆226Updated 9 months ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆174Updated last year
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated 3 weeks ago
• danielvdende / data-testing-with-airflow
  ☆199Updated last year
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆141Updated 2 weeks ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆169Updated last year
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆163Updated 4 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆324Updated 10 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• awslabs / aws-glue-data-catalog-client-for-apache-hive-metastore
  The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…
  ☆222Updated 3 months ago
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆86Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆217Updated 3 weeks ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆75Updated 6 years ago
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆40Updated 6 years ago
• aws-samples / emr-serverless-samples
  Example code for running Spark and Hive jobs on EMR Serverless.
  ☆166Updated 6 months ago
• astronomer / airflow-example-dags
  Sample Airflow DAGs
  ☆62Updated 2 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 9 months ago
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆255Updated 2 weeks ago
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆167Updated this week
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆89Updated 3 weeks ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆701Updated last week
• akashmehta10 / profiling_pyspark
  ☆26Updated 2 years ago
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆436Updated 5 months ago
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 5 years ago
• aws-samples / dbt-glue
  This repository contains the dbt-glue adapter
  ☆127Updated this week
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• gocardless / airflow-dbt
  Apache Airflow integration for dbt
  ☆409Updated last year