Alternatives and similar repositories for pyspark-cicd-template

Users that are interested in pyspark-cicd-template are comparing it to the libraries listed below

• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆168Updated last year
• dacort / modern-data-lake-storage-layers
  Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work
  ☆47Updated 2 years ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated 11 months ago
• dbt-labs / dbt-databricks-demo
  Demo project for dbt on Databricks
  ☆32Updated 4 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆259Updated 8 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆164Updated last week
• akashmehta10 / profiling_pyspark
  ☆26Updated last year
• aws-samples / emr-serverless-samples
  Example code for running Spark and Hive jobs on EMR Serverless.
  ☆164Updated 4 months ago
• awslabs / amazon-emr-vscode-toolkit
  A VS Code Extension to make it easier to manage and develop Spark jobs on EMR
  ☆37Updated 3 months ago
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆85Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• alexott / spark-playground
  Playing with different packages of the Apache Spark
  ☆28Updated 11 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆225Updated 7 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated this week
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆40Updated 6 years ago
• danielvdende / data-testing-with-airflow
  ☆199Updated last year
• aws-samples / dbt-glue
  This repository contains the dbt-glue adapter
  ☆123Updated this week
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆173Updated last year
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 6 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• astronomer / airflow-example-dags
  Sample Airflow DAGs
  ☆62Updated 2 years ago
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆75Updated 6 years ago
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆107Updated last year
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 8 months ago
• aws-samples / spark-on-aws-lambda
  Spark runtime on AWS Lambda
  ☆107Updated 8 months ago
• aws-samples / amazon-eks-apache-spark-etl-sample
  Spark ETL example processing New York taxi rides public dataset on EKS
  ☆45Updated 2 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆140Updated last month