Alternatives and similar repositories for pyspark-cicd-template

Users that are interested in pyspark-cicd-template are comparing it to the libraries listed below

• mrpowers-io / spark-style-guide
  Spark style guide
  ☆263Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated last week
• delta-io / delta-examples
  Delta Lake examples
  ☆228Updated last year
• aws-samples / amazon-deequ-glue
  Automated data quality suggestions and analysis with Deequ on AWS Glue
  ☆88Updated 2 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆142Updated 3 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated this week
• awslabs / aws-glue-data-catalog-client-for-apache-hive-metastore
  The AWS Glue Data Catalog is a fully managed, Apache Hive Metastore compatible, metadata repository. Customers can use the Data Catalog a…
  ☆225Updated 6 months ago
• aws-samples / emr-serverless-samples
  Example code for running Spark and Hive jobs on EMR Serverless.
  ☆168Updated 8 months ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• aws-samples / spark-on-aws-lambda
  Spark runtime on AWS Lambda
  ☆110Updated last month
• awslabs / amazon-emr-vscode-toolkit
  A VS Code Extension to make it easier to manage and develop Spark jobs on EMR
  ☆39Updated 7 months ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆178Updated 2 years ago
• danielvdende / data-testing-with-airflow
  ☆201Updated last year
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆169Updated last year
• vivek-bombatkar / Databricks-Apache-Spark-2X-Certified-Developer
  Databricks - Apache Spark™ - 2X Certified Developer
  ☆266Updated 5 years ago
• marclamberti / webinar-airflow-chart
  Materials of the Official Helm Chart Webinar
  ☆27Updated 4 years ago
• aws-samples / dbt-glue
  This repository contains the dbt-glue adapter
  ☆134Updated last week
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆324Updated last year
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆163Updated 4 years ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆50Updated last year
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆77Updated 6 years ago
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆222Updated 2 years ago
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆29Updated 4 years ago
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆41Updated 6 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆34Updated 4 years ago
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆108Updated 3 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆107Updated last year
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated 9 months ago