End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)
☆28Aug 9, 2024Updated last year
Alternatives and similar repositories for E2E-Data-Engineering-in-Azure
Users that are interested in E2E-Data-Engineering-in-Azure are comparing it to the libraries listed below
Sorting:
- Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization☆21Jul 16, 2023Updated 2 years ago
- Using a combination of Excel, SQL, and Tableau, I delved into the extensive datasets comprising over 82k rows of data from Netflix's show…☆101Jul 10, 2023Updated 2 years ago
- ☆13Apr 18, 2024Updated last year
- ☆16Apr 1, 2025Updated 11 months ago
- Debian 10 (Buster) based Docker in Docker container for Ansible playbook and role testing.☆10Apr 17, 2021Updated 4 years ago
- Udacity Data Engineering Nano Degree Project, Data Modeling for fact and dimension tables, and ETL pipeline that transfers data from file…☆10Dec 12, 2020Updated 5 years ago
- Python - Complete Python, Django, Data Science and ML Guide, published by Packt☆15Dec 15, 2025Updated 2 months ago
- ☆14May 14, 2024Updated last year
- Grupo de estudio Apache Airflow organizado por la comunidad Data Engineering Latam☆18Jan 4, 2024Updated 2 years ago
- ☆12Jul 22, 2025Updated 7 months ago
- Data Analysis Power BI project for Sales Insights.☆13Jan 6, 2023Updated 3 years ago
- ☆12Oct 15, 2023Updated 2 years ago
- 🔧 Azure Data Engineering Project (On-premise db to the cloud)☆17Mar 30, 2024Updated last year
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆18Apr 25, 2024Updated last year
- A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc☆16Mar 18, 2022Updated 3 years ago
- ASIO plugin for OBS-Studio☆17Nov 1, 2025Updated 4 months ago
- Manual deployment of JupyterHub on Kubernetes for a single machine☆15Mar 1, 2023Updated 3 years ago
- Arch Linux dotfiles.☆18Mar 19, 2024Updated last year
- This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2017LT Dat…☆20Feb 19, 2025Updated last year
- Code and Projects for Data Analyst Nanodegree.☆19Sep 22, 2018Updated 7 years ago
- Big Data project using Hadoop (MapReduce, spark, Hive)☆32Dec 10, 2019Updated 6 years ago
- Complete PySpark Guide for the beginners... I prepared this notebook for my students.☆19Sep 18, 2019Updated 6 years ago
- carto sql lib for node☆18Updated this week
- This repository for Computer Networks class (Spring 2019), Faculty Of Engineering, Alexandria University. It contains some useful resourc…☆15Nov 27, 2019Updated 6 years ago
- ☆27Jul 20, 2025Updated 7 months ago
- End-to-end data engineer project☆23Aug 17, 2023Updated 2 years ago
- Project with Airflow + Spark + MinIO + Postgres + Python3.8☆28Sep 9, 2022Updated 3 years ago
- ☆38Feb 2, 2025Updated last year
- Airflow Tutorials☆25Feb 28, 2021Updated 5 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 2 years ago
- Fully automated csv to dashboard pipeline using Terraform, Google Cloud Storage, BigQuery, dbt, Prefect and Looker Studio. Peer ranked …☆42Nov 15, 2024Updated last year
- Biblia în linia de comandă - Matei 22:29 Răspunzând, Iisus le-a zis: Vă rătăciţi neştiind Scripturile, nici puterea lui Dumnezeu. - (CLI…☆25Sep 24, 2023Updated 2 years ago
- My own ETL pipeline of random users utilising Postgres for long term storage and Redis for caching. Served up via FastAPI and Docker☆31Oct 22, 2024Updated last year
- Yet another ChatGPT UI, but more fit and svelte. Sveltekit app to have multiple conversations with chatbots.☆32Apr 17, 2023Updated 2 years ago
- This repo is for the Linkedin Learning course: End-to-End Data Engineering Project☆29Nov 9, 2023Updated 2 years ago
- All important Python tools a Data Engineer needs☆28Jun 4, 2024Updated last year
- Data Engineering Project: Extracting music video metrics of Twice using YouTube API, AWS, and Tableau☆32Nov 21, 2023Updated 2 years ago
- Data Engineering Project with Hadoop HDFS and Kafka☆122Nov 4, 2023Updated 2 years ago
- ☆53Mar 18, 2024Updated last year