josephmachado / spark_submit_airflow

Related projects: ⓘ

• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆89Updated 3 months ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆239Updated last year
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆100Updated last month
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆138Updated 3 months ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆167Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆49Updated last year
• databricks / dbt-databricks
  A dbt adapter for Databricks.
  ☆211Updated this week
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆167Updated 10 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆225Updated 2 months ago
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆100Updated 2 months ago
• dsynkov / spark-livy-on-airflow-workspace
  A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.
  ☆39Updated 3 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆156Updated 6 months ago
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆155Updated 3 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆201Updated 3 months ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆111Updated last year
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆39Updated 5 years ago
• EcZachly / cumulative-table-design
  This repository helps teach people how to correctly define and create cumulative tables!
  ☆209Updated last month
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆71Updated last year
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆138Updated 4 years ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆71Updated 9 months ago
• tomasfarias / airflow-dbt-python
  A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  ☆170Updated 2 months ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 5 years ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆101Updated last year
• HoracioSoldman / batch-processing-on-aws
  With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…
  ☆12Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆42Updated last year
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆69Updated 3 months ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆27Updated 3 years ago
• SebasMBK / SunglassesHubETL
  This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process
  ☆44Updated last year
• ftupas / dbt-spotify-analytics
  Containerized end-to-end analytics of Spotify data using Python, dbt, Postgres, and Metabase
  ☆121Updated 2 years ago