Alternatives and similar repositories for pyspark-cicd-template

Users that are interested in pyspark-cicd-template are comparing it to the libraries listed below

• mrpowers-io / spark-style-guide
  Spark style guide
  ☆260Updated 10 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆189Updated this week
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆86Updated 2 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆227Updated 9 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated last month
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆163Updated 4 years ago
• aws-samples / dbt-glue
  This repository contains the dbt-glue adapter
  ☆128Updated last week
• awslabs / aws-glue-data-catalog-client-for-apache-hive-metastore
  The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…
  ☆222Updated 4 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆325Updated 11 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• aws-samples / emr-serverless-samples
  Example code for running Spark and Hive jobs on EMR Serverless.
  ☆167Updated 6 months ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆169Updated last year
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆75Updated 6 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆142Updated last month
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆174Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last week
• danielvdende / data-testing-with-airflow
  ☆200Updated last year
• awslabs / amazon-emr-vscode-toolkit
  A VS Code Extension to make it easier to manage and develop Spark jobs on EMR
  ☆38Updated 5 months ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆88Updated 4 years ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆709Updated this week
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆179Updated 3 years ago
• vivek-bombatkar / Databricks-Apache-Spark-2X-Certified-Developer
  Databricks - Apache Spark™ - 2X Certified Developer
  ☆265Updated 5 years ago
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆26Updated last month
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 10 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated last year
• alexott / spark-playground
  Playing with different packages of the Apache Spark
  ☆30Updated last year
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆40Updated 6 years ago
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆168Updated last week