egehanyorulmaz / reference_etl
Tutorial for easy-to-manage data pipelines with Airflow
☆10Updated 2 years ago
Alternatives and similar repositories for reference_etl:
Users that are interested in reference_etl are comparing it to the libraries listed below
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆75Updated 5 years ago
- Simple ETL pipeline using Python☆24Updated last year
- PipeRider dbt workshop for DataTalksClub DE Zoomcamp☆17Updated last year
- ☆86Updated 2 years ago
- Project for "Data pipeline design patterns" blog.☆43Updated 5 months ago
- Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift☆14Updated 5 years ago
- Udacity Data Engineer Nano Degree - Project-3 (Data Warehouse)☆22Updated 5 years ago
- Data lake, data warehouse on GCP☆55Updated 3 years ago
- ☆42Updated 3 years ago
- ☆34Updated last year
- ☆28Updated last year
- Example repo to create end to end tests for data pipeline.☆21Updated 7 months ago
- Processing TfL data for bike usage with Google Cloud Platform.☆42Updated 2 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- Course Material Data Engineering on AWS Course☆28Updated 4 months ago
- how to unit test your PySpark code☆28Updated 3 years ago
- Content related to Mastering Postgresql along with videos.☆14Updated 3 years ago
- End-to-end ELT data engineering project☆20Updated 2 years ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆16Updated 5 years ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆31Updated 8 months ago
- ☆30Updated last month
- Template for Data Engineering and Data Pipeline projects☆106Updated 2 years ago
- End to end data engineering project☆53Updated 2 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆86Updated 3 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆25Updated 2 years ago
- Udacity Data Streaming Nanodegree Program☆22Updated 3 years ago
- Delta-Lake, ETL, Spark, Airflow☆45Updated 2 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆28Updated last year
- LinkedIn Learning - Advanced SQL Series☆61Updated 5 months ago