Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization
☆22Jul 16, 2023Updated 2 years ago
Alternatives and similar repositories for Azure-Data-Engineering
Users that are interested in Azure-Data-Engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)☆34Aug 9, 2024Updated last year
- This repository contains SQL queries from various popular online learning resources e.g. Vertabelo Academy, SQLZoo etc.☆45Jun 22, 2019Updated 6 years ago
- ☆13Feb 14, 2025Updated last year
- Includes all the Practice Material and Project☆25May 19, 2025Updated 10 months ago
- ☆14Apr 18, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Step by step instructions to create a production-ready data pipeline☆58Dec 23, 2024Updated last year
- This Repo contains Jupyter Notebooks to recap on RDD, DataFrame, Spark Streaming and ML operations using Pyspark☆11Nov 3, 2024Updated last year
- Using a combination of Excel, SQL, and Tableau, I delved into the extensive datasets comprising over 82k rows of data from Netflix's show…☆104Jul 10, 2023Updated 2 years ago
- This project aims to move the data from a Relational database system (RDBMS) to a Hadoop file system (HDFS)☆11Apr 29, 2022Updated 3 years ago
- ☆16Apr 1, 2025Updated last year
- A data pipeline for processing football data using Python and SQL☆13Sep 12, 2023Updated 2 years ago
- ☆17Feb 1, 2025Updated last year
- Python - Complete Python, Django, Data Science and ML Guide, published by Packt☆15Dec 15, 2025Updated 3 months ago
- ☆13Mar 7, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A project portfolio to accompany my resume☆30Sep 5, 2023Updated 2 years ago
- ☆29Oct 24, 2024Updated last year
- ☆32Mar 7, 2018Updated 8 years ago
- Azure Data Factory Cookbook_Second Edition, published by Packt☆19Feb 29, 2024Updated 2 years ago
- Python wrapper for Goodreads API☆30Feb 20, 2020Updated 6 years ago
- Fully automated csv to dashboard pipeline using Terraform, Google Cloud Storage, BigQuery, dbt, Prefect and Looker Studio. Peer ranked …☆44Nov 15, 2024Updated last year
- Repo containing all of my Data engineering projects☆13May 4, 2025Updated 11 months ago
- ☆12Jul 22, 2025Updated 8 months ago
- Use of computer vision to detect shoplifting activity and report it into a smart dashboard☆19Oct 16, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆19Jun 22, 2022Updated 3 years ago
- A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc☆16Mar 18, 2022Updated 4 years ago
- Repository for my flipper zero badUSB payloads. Now almost entirely plug and play.☆26Jan 16, 2026Updated 2 months ago
- For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning☆100Nov 22, 2017Updated 8 years ago
- ☆73Jan 24, 2026Updated 2 months ago
- Outputs the sentiment for the top 100 subreddits. Also included is a scraper for writing an updated top 100 subreddits to a text file.☆22Mar 18, 2020Updated 6 years ago
- All important Python tools a Data Engineer needs☆28Jun 4, 2024Updated last year
- This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2017LT Dat…☆23Feb 19, 2025Updated last year
- Data Engineering Project: Extracting music video metrics of Twice using YouTube API, AWS, and Tableau☆32Nov 21, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Databricks DLT Apparel Pipeline Project: Learn medallion architecture, streaming, and data engineering with Delta Live Tables. Includes s…☆41Feb 25, 2026Updated last month
- Feature demos, integration guides & hands-on labs/projects using Kpow, Flex, Kafka, Flink, Iceberg & more☆51Mar 30, 2026Updated last week
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 2 years ago
- datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments☆147Nov 29, 2022Updated 3 years ago
- Biblia în linia de comandă - Matei 22:29 Răspunzând, Iisus le-a zis: Vă rătăciţi neştiind Scripturile, nici puterea lui Dumnezeu. - (CLI…☆25Sep 24, 2023Updated 2 years ago
- ☆32Feb 27, 2026Updated last month
- Jupyter notebooks for course Building and Evaluating Advanced RAG Applications, taught by Jerry Liu (Co-founder and CEO of LlamaIndex) an…☆50Feb 6, 2024Updated 2 years ago