josephmachado / spark_submit_airflow

Related projects ⓘ

Alternatives and complementary repositories for spark_submit_airflow

• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆245Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆92Updated 5 months ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆167Updated last year
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆111Updated 4 months ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆113Updated last month
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆143Updated 5 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆51Updated 2 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆113Updated last year
• CodyAustinDavis / dbsql_sme
  DBSQL SME Repo contains demos, tutorials, blog code, advanced production helper functions and more!
  ☆37Updated last week
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• astronomer / cosmos-demo
  Demo DAGs that show how to run dbt Core in Airflow using Cosmos
  ☆46Updated last month
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆158Updated 3 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆133Updated 4 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆43Updated 5 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 5 months ago
• tomasfarias / airflow-dbt-python
  A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  ☆181Updated 4 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆304Updated 2 months ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆104Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆241Updated 4 months ago
• ovimihai / airflow-cert-dag-authoring
  Course notes for the Astronomer Certification DAG Authoring for Apache Airflow
  ☆51Updated 7 months ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆86Updated last month
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 5 years ago
• tatwan / airflow-spark-aws-emr
  ☆11Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month