Alternatives and similar repositories for pyspark-k8s-boilerplate

Users that are interested in pyspark-k8s-boilerplate are comparing it to the libraries listed below

• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆29Updated 4 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆47Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆149Updated this week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆70Updated 9 months ago
• astronomer / airflow-testing-guide
  ☆23Updated 4 years ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆70Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• cordon-thiago / spark-schema-merge
  Spark app to merge different schemas
  ☆23Updated 4 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆95Updated 4 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆226Updated 9 months ago
• jacopotagliabue / paas-data-ingestion
  Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner
  ☆71Updated 3 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 10 months ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆37Updated last year
• mahdiqb / modern_data_platform
  Sample configuration to deploy a modern data platform.
  ☆88Updated 3 years ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆46Updated 11 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated last year
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆167Updated this week
• infinitelambda / dq-tools
  Make simple storing test results and visualisation of these in a BI dashboard
  ☆45Updated 2 weeks ago
• jamesweakley / snowflake-rbgm
  Rules based grant management for Snowflake
  ☆40Updated 6 years ago
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆61Updated 2 years ago
• castor-team / airflow-castor
  ☆42Updated 3 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆178Updated 3 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆53Updated 4 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆33Updated 2 years ago
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆33Updated 5 months ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆202Updated 2 months ago
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆260Updated 2 years ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last month