End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)
☆40Aug 9, 2024Updated 2 years ago
Alternatives and similar repositories for E2E-Data-Engineering-in-Azure
Users that are interested in E2E-Data-Engineering-in-Azure are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Using a combination of Excel, SQL, and Tableau, I delved into the extensive datasets comprising over 82k rows of data from Netflix's show…☆117Jul 10, 2023Updated 3 years ago
- An "End-to-End Machine Learning" project focuses on building a machine learning pipeline that prevents data leakage and deploys the model…☆16Aug 5, 2025Updated last year
- This repository contains SQL queries from various popular online learning resources e.g. Vertabelo Academy, SQLZoo etc.☆50Jul 29, 2026Updated 2 weeks ago
- This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2017LT Dat…☆27Feb 19, 2025Updated last year
- Integrating Apache Airflow, dbt, Great Expectations and Apache Superset to develop a modern open source data stack.☆19Jun 19, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Sep 19, 2023Updated 2 years ago
- ☆16May 14, 2024Updated 2 years ago
- For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning☆100Nov 22, 2017Updated 8 years ago
- An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Az…☆31Oct 2, 2023Updated 2 years ago
- ☆11Feb 1, 2024Updated 2 years ago
- ☆29Oct 27, 2025Updated 9 months ago
- Data Engineering Project with Hadoop HDFS and Kafka☆126Nov 4, 2023Updated 2 years ago
- ☆11Dec 1, 2025Updated 8 months ago
- ☆20Oct 24, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- In this project I used apache airflow to scrape website periodically. This is for the tutorials I do on youtube.☆10Nov 21, 2022Updated 3 years ago
- A DuckDB extension for working with Kaggle datasets☆17Jul 22, 2026Updated 3 weeks ago
- ☆17Apr 18, 2024Updated 2 years ago
- ☆10Feb 27, 2025Updated last year
- ☆12Nov 3, 2024Updated last year
- ☆30Jun 22, 2026Updated last month
- A simulated SQL-based financial analytics project focused on customer segmentation, transaction behaviour, and regional performance withi…☆29May 27, 2025Updated last year
- This demo shows how to capture data changes from relational databases (Oracle and PostgreSQL) and stream them to Confluent Cloud, use ksq…☆17Jan 10, 2025Updated last year
- ☆17Aug 2, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Programming solution for Hackerrank certification questions. Language: Python3☆12Aug 24, 2023Updated 2 years ago
- ☆12Oct 29, 2023Updated 2 years ago
- TweetBot is a bot that auto-tweets a list of tweets that is supplied to it, with hashtags and from multiple accounts.☆11Dec 10, 2022Updated 3 years ago
- ☆17Jun 27, 2026Updated last month
- End-to-end Azure DE project with Australia Health Expenditure dataset. Services used include Azure Data Factory, DataBricks, Data Lake, K…☆12Feb 25, 2024Updated 2 years ago
- 170+ curated resources every Databricks Data Engineer should bookmark - tools, courses, creators, labs, and communities☆43Jul 13, 2026Updated last month
- ☆18Feb 1, 2025Updated last year
- Capstone project for the Google Data Analytics Professional Certificate. This project focused on analyzing Cyclistic (fictional bike-shar…☆16Sep 24, 2024Updated last year
- 100 essential Databricks concepts for data engineers, organized by category with difficulty levels and self-assessment scoring☆41May 28, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Data engineering interview prep - PySpark notebooks, theory docs, quizzes, and company-specific patterns. Built around Zephyr Coffee Co.,…☆74Jul 7, 2026Updated last month
- The paper list of "Memory in the Age of AI Agents: A Survey"☆15Dec 19, 2025Updated 7 months ago
- ☆16Jul 28, 2024Updated 2 years ago
- Production-grade distributed data engineering labs focused on Spark internals, large-scale performance tuning, skew handling, streaming s…☆18Mar 17, 2026Updated 4 months ago
- ☆17Feb 14, 2025Updated last year
- This project showcases how to integrate the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) with …☆14Dec 27, 2023Updated 2 years ago
- This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project de…☆12Nov 18, 2023Updated 2 years ago