Alternatives and similar repositories for PySpark-PyData:

Users that are interested in PySpark-PyData are comparing it to the libraries listed below

• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆104Updated 6 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated last year
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆86Updated 3 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆195Updated 4 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆214Updated 3 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆74Updated last year
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆257Updated 4 months ago
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆160Updated 3 years ago
• monte-carlo-data / data-downtime-challenge
  ☆84Updated last year
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 3 years ago
• Realsid / databricks-spark-certification
  Guide for databricks spark certification
  ☆58Updated 3 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆315Updated 4 months ago
• joelcthomas / ml-azuredatabricks
  Collection of Machine Learning Examples for Azure Databricks
  ☆40Updated 4 years ago
• monte-carlo-data / data-observability-in-practice
  Source code for the MC technical blog post "Data Observability in Practice Using SQL"
  ☆36Updated 6 months ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆75Updated 5 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆168Updated last week
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• tirthajyoti / Spark-with-Python
  Fundamentals of Spark with Python (using PySpark), code examples
  ☆342Updated 2 years ago
• vivek-bombatkar / Databricks-Apache-Spark-2X-Certified-Developer
  Databricks - Apache Spark™ - 2X Certified Developer
  ☆265Updated 4 years ago
• niall-turbitt / e2e-mlops
  [DEPRECATED] Demo repository implementing an end-to-end MLOps workflow on Databricks. Project derived from dbx basic python template
  ☆110Updated last year
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆22Updated 2 years ago
• ovimihai / airflow-cert-dag-authoring
  Course notes for the Astronomer Certification DAG Authoring for Apache Airflow
  ☆52Updated 10 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆244Updated 5 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆192Updated this week
• andfanilo / pyspark-tutorial
  Jupyter notebooks for pyspark tutorials given at University
  ☆107Updated last month
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆99Updated 2 years ago
• UrbanInstitute / pyspark-tutorials
  Code snippets and tutorials for working with social science data in PySpark
  ☆419Updated 7 years ago
• runawayhorse001 / LearningApacheSpark
  LearningApacheSpark
  ☆245Updated last year