egehanyorulmaz / reference_etl
Tutorial for easy-to-manage data pipelines with Airflow
☆10Updated 2 years ago
Alternatives and similar repositories for reference_etl:
Users that are interested in reference_etl are comparing it to the libraries listed below
- Processing TfL data for bike usage with Google Cloud Platform.☆44Updated 2 years ago
- ☆20Updated 3 months ago
- PipeRider dbt workshop for DataTalksClub DE Zoomcamp☆17Updated last year
- Project for "Data pipeline design patterns" blog.☆43Updated 6 months ago
- Example repo to create end to end tests for data pipeline.☆22Updated 8 months ago
- This repo will guide you step-by-step method to create star schema dimensional model.☆24Updated 3 years ago
- End to end data engineering project☆53Updated 2 years ago
- Creating Data Pipelines with Apache Airflow to manage ETL from Amazon S3 into Amazon Redshift☆14Updated 5 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- Code for dbt tutorial☆151Updated 8 months ago
- A tutorial for the Great Expectations library.☆69Updated 4 years ago
- Some of useful materials I'm using to pass the Google Cloud Professional Data Engineer Certification Exam☆34Updated 5 years ago
- ☆25Updated last year
- A simple VS Code devcontainer setup for local PySpark development☆45Updated last year
- End-to-end ELT data engineering project☆20Updated 2 years ago
- ☆35Updated 2 years ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆126Updated 7 months ago
- Simple stream processing pipeline☆98Updated 8 months ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆76Updated 5 years ago
- Creation of a Fantasy Premier League data pipeline for analysis of both team & player performance. Technologies include, dbt, Prefect, Te…☆11Updated last year
- ☆13Updated last year
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆57Updated 3 years ago
- A quickstart repo for Mage using Docker compose.☆18Updated last year
- Simple ETL pipeline using Python☆25Updated last year
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆11Updated 2 years ago
- ☆15Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆114Updated 2 years ago
- A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL☆39Updated 5 years ago
- Spark application to consume kafka events generated by a python producer.☆12Updated 3 years ago
- build dw with dbt☆36Updated 3 months ago