Alternatives and similar repositories for PySpark-PyData:

Users that are interested in PySpark-PyData are comparing it to the libraries listed below

• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆315Updated 5 months ago
• niall-turbitt / e2e-mlops
  [DEPRECATED] Demo repository implementing an end-to-end MLOps workflow on Databricks. Project derived from dbx basic python template
  ☆110Updated 2 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆86Updated 4 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆171Updated 3 weeks ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆68Updated last week
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆22Updated 2 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated last year
• monte-carlo-data / data-observability-in-practice
  Source code for the MC technical blog post "Data Observability in Practice Using SQL"
  ☆36Updated 6 months ago
• dennyglee / databricks
  Repository of sample Databricks notebooks
  ☆254Updated 10 months ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 3 years ago
• alexott / spark-playground
  Playing with different packages of the Apache Spark
  ☆28Updated 8 months ago
• GoogleCloudDataproc / spark-bigquery-connector
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆386Updated this week
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆257Updated 4 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆215Updated 4 months ago
• newfront / spark-moderndataengineering
  The source code for the book Modern Data Engineering with Apache Spark
  ☆35Updated 2 years ago
• monte-carlo-data / data-downtime-challenge
  ☆84Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆199Updated this week
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆160Updated 3 years ago
• data-engineering-helpers / data-contracts
  Food for thoughts around data contracts
  ☆24Updated 2 weeks ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• mlflow / mlp-regression-template
  Example repo to kickstart integration with mlflow pipelines.
  ☆74Updated 2 years ago
• feast-dev / feast-workshop
  A workshop with several modules to help learn Feast, an open-source feature store
  ☆86Updated last month
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆195Updated 5 years ago
• omnata-labs / dbt-ml-preprocessing
  A SQL port of python's scikit-learn preprocessing module, provided as cross-database dbt macros.
  ☆184Updated last year
• tatwan / airflow-spark-aws-emr
  ☆11Updated 3 years ago
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆123Updated 6 months ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆661Updated last month
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆102Updated 2 years ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆104Updated 4 months ago