Alternatives and similar repositories for pyspark-k8s-boilerplate

Users that are interested in pyspark-k8s-boilerplate are comparing it to the libraries listed below

• soyelherein / pyspark-cicd-template
  PySpark data-pipeline testing and CICD
  ☆28Updated 5 years ago
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆29Updated 4 years ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆676Updated 8 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆233Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆222Updated last week
• cluster-apps-on-docker / spark-standalone-cluster-on-docker
  Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.
  ☆500Updated 3 weeks ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆182Updated 3 years ago
• soggycactus / airflow-repo-template
  The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.
  ☆257Updated 4 years ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆730Updated 2 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated last year
• astronomer / astro-sdk
  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
  ☆375Updated 6 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆265Updated last year
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆262Updated 2 years ago
• zsvoboda / ngods-stocks
  New Generation Opensource Data Stack Demo
  ☆452Updated 2 years ago
• castor-team / airflow-castor
  ☆42Updated 4 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆324Updated last year
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆97Updated last week
• delta-io / delta-docs
  Delta Lake Documentation
  ☆51Updated last year
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆275Updated last month
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 3 years ago
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆261Updated 3 years ago
• awslabs / python-deequ
  Python API for Deequ
  ☆806Updated 7 months ago
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆38Updated 4 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆175Updated 6 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• garystafford / streaming-sales-generator
  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
  ☆44Updated 2 years ago
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆77Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• bitsondatadev / trino-getting-started
  ☆269Updated last year
• zsvoboda / ngods
  New generation opensource data stack
  ☆75Updated 3 years ago