abduldjafar / elt-with-dagster
☆12Updated 2 years ago
Alternatives and similar repositories for elt-with-dagster:
Users that are interested in elt-with-dagster are comparing it to the libraries listed below
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆95Updated 5 months ago
- Sample project to demonstrate data engineering best practices☆174Updated 10 months ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- End to end data engineering project☆53Updated 2 years ago
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆132Updated 4 years ago
- ☆116Updated 3 months ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆22Updated 2 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆135Updated 4 years ago
- This repo contains commands that data engineers use in day to day work.☆60Updated last year
- Template for Data Engineering and Data Pipeline projects☆106Updated 2 years ago
- This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process☆45Updated 2 years ago
- Code for dbt tutorial☆149Updated 7 months ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆119Updated 6 months ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆75Updated 5 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆99Updated 4 years ago
- Repo for CDC with debezium blog post☆28Updated 4 months ago
- This repo will guide you step-by-step method to create star schema dimensional model.☆24Updated 3 years ago
- Simple ETL pipeline using Python☆24Updated last year
- Just starting your DE journey or along the way already?. I will be sharing a short list of DATA-ENGINEERING-CENTRED books that covers the…☆34Updated 2 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆25Updated 2 years ago
- Code for my "Efficient Data Processing in SQL" book.☆54Updated 5 months ago
- An example of an ETL pipeline that lays out generic DE processes. This is now out of date but still provides useful information☆28Updated 2 years ago
- Ravi Azure ADB ADF Repository☆65Updated last month
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆21Updated last year
- This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.☆55Updated 5 months ago
- PySpark Cheatsheet☆35Updated 2 years ago
- ☆40Updated 6 months ago
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆100Updated 2 years ago