axel-sirota / productionalizing-data-pipelines-airflow
Productionalizing Data Pipelines with Apache Airflow
☆111Updated 2 years ago
Related projects: ⓘ
- Snowflake Cookbook, published by Packt☆72Updated last year
- ☆164Updated 3 years ago
- Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.☆61Updated 3 years ago
- Study materials for the AWS Big Data / Data Analytics Specialty Exam☆26Updated 2 years ago
- ☆102Updated last month
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Updated 2 years ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆69Updated 5 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆166Updated 2 years ago
- ☆25Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated 10 months ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆31Updated 3 years ago
- ☆48Updated last year
- Source Code Collection and Supplemental Material for the O'Reilly Snowflake Definitive Guide 1st Edition book☆90Updated last year
- ☆56Updated 3 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆79Updated 5 years ago
- The resources of the preparation course for Databricks Data Engineer Professional certification exam☆73Updated 9 months ago
- Execution of DBT models using Apache Airflow through Docker Compose☆111Updated last year
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Updated 2 years ago
- Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.☆138Updated 4 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆127Updated 4 years ago
- Sample project to demonstrate data engineering best practices☆156Updated 6 months ago
- Guide for databricks spark certification☆57Updated 3 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆34Updated 4 years ago
- Data Engineering with AWS, Published by Packt☆302Updated last year
- ☆51Updated 3 years ago
- Quickstart: Getting Started with Snowpark Python☆32Updated last year
- Template for Data Engineering and Data Pipeline projects☆101Updated last year
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆132Updated 4 years ago
- An example of an ETL pipeline that lays out generic DE processes. This is now out of date but still provides useful information☆26Updated 2 years ago
- ☆35Updated 8 months ago