Alternatives and similar repositories for pyspark-template

Users that are interested in pyspark-template are comparing it to the libraries listed below

• delta-io / delta-examples
  Delta Lake examples
  ☆227Updated 11 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆325Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated last week
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆263Updated 11 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆219Updated last month
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 2 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• bartosz25 / spark-playground
  Code snippets used in demos recorded for the blog.
  ☆37Updated last month
• sdesilva26 / docker-spark
  Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines
  ☆134Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆182Updated 6 months ago
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆107Updated 2 months ago
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 2 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated last year
• quby-io / databricks-workflow
  Example of a scalable IoT data processing pipeline setup using Databricks
  ☆32Updated 4 years ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆675Updated 6 months ago
• StabRise / spark-pdf
  PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it
  ☆75Updated 4 months ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆714Updated last month
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆22Updated 3 years ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆203Updated this week
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆102Updated this week
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆221Updated 2 years ago
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆266Updated last week
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆108Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆229Updated last month
• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆65Updated 3 weeks ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆161Updated last week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆70Updated last week
• delta-incubator / delta-lake-definitive-guide
  ☆46Updated 7 months ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 2 years ago
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆96Updated last year