egehanyorulmaz / reference_etl
Tutorial for easy-to-manage data pipelines with Airflow
☆9Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for reference_etl
- Project for "Data pipeline design patterns" blog.☆41Updated 3 months ago
- Django-based course management platform for Zoomcamps☆54Updated this week
- Simple ETL pipeline using Python☆20Updated last year
- Example repo to create end to end tests for data pipeline.☆21Updated 5 months ago
- Processing TfL data for bike usage with Google Cloud Platform.☆42Updated 2 years ago
- Data pipeline that scrapes Rust cheater Steam profiles☆50Updated 2 years ago
- Code for my "Efficient Data Processing in SQL" book.☆49Updated 3 months ago
- ☆86Updated 2 years ago
- ☆27Updated 11 months ago
- ☆30Updated last year
- End-to-end ELT data engineering project☆20Updated last year
- ☆36Updated last year
- build dw with dbt☆29Updated 3 weeks ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆73Updated 5 years ago
- Python ETL demo for Hackforge☆31Updated last year
- Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator☆11Updated 3 years ago
- ☆21Updated last year
- implementing an end-to-end tweets ETL/Analysis pipeline.☆57Updated last year
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 5 years ago
- Data Engineering with Google Cloud Platform, published by Packt☆109Updated last year
- ☆42Updated 3 years ago
- Data Engineering examples for Airflow, Prefect, and Mage.ai; dbt for BigQuery, Redshift, ClickHouse, PostgreSQL; Spark/PySpark for Batch …☆50Updated this week
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Updated 2 years ago
- In this repository we will store all materials for workshops, courses, etc.☆34Updated last week
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆94Updated last year
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Updated 2 years ago
- Data Quest - Data Engineer Learning and Projects☆24Updated 5 years ago
- A Series of Notebooks on how to start with Kafka and Python☆153Updated last year
- A repo to track data engineering projects☆13Updated 2 years ago
- A simple VS Code devcontainer setup for local PySpark development☆38Updated last year