Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization
☆29Jul 16, 2023Updated 3 years ago
Alternatives and similar repositories for Azure-Data-Engineering
Users that are interested in Azure-Data-Engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)☆41Aug 9, 2024Updated 2 years ago
- Using a combination of Excel, SQL, and Tableau, I delved into the extensive datasets comprising over 82k rows of data from Netflix's show…☆122Jul 10, 2023Updated 3 years ago
- Python wrapper for Goodreads API☆30Feb 20, 2020Updated 6 years ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Sep 19, 2023Updated 3 years ago
- ☆15May 14, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Airflow Tutorials☆25Feb 28, 2021Updated 5 years ago
- An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Az…☆30Oct 2, 2023Updated 3 years ago
- ☆30Sep 10, 2026Updated 3 weeks ago
- ☆10Aug 21, 2026Updated last month
- A data pipeline for processing football data using Python and SQL☆13Sep 12, 2023Updated 3 years ago
- ☆23Mar 6, 2025Updated last year
- ☆17Aug 2, 2025Updated last year
- ☆17Jun 27, 2026Updated 3 months ago
- Discover NLP features powered by ChatGPT you can use in Excel☆17Jun 11, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Data Engineering Project with Hadoop HDFS and Kafka☆131Nov 4, 2023Updated 2 years ago
- Production-grade distributed data engineering labs focused on Spark internals, large-scale performance tuning, skew handling, streaming s…☆18Mar 17, 2026Updated 6 months ago
- Repo containing all of my Data engineering projects☆14Sep 26, 2026Updated last week
- This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark cluste…☆11Oct 11, 2023Updated 2 years ago
- A project portfolio to accompany my resume☆31Sep 5, 2023Updated 3 years ago
- This repository showcases a collection of machine learning projects in various domains, demonstrating my skills and expertise as a data s…☆12Nov 20, 2023Updated 2 years ago
- Python - Complete Python, Django, Data Science and ML Guide, published by Packt☆19Dec 15, 2025Updated 9 months ago
- Azure Data Factory Cookbook_Second Edition, published by Packt☆20Feb 29, 2024Updated 2 years ago
- A sample project combining Microsoft Fabric Lakehouse, DuckLake and SQLMesh☆16Jun 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆19Jun 22, 2022Updated 4 years ago
- Analysis of SQL Leetcode and classic interview questions, common pitfalls, anti-patterns and handy tricks. Sample databases.☆1,266May 22, 2023Updated 3 years ago
- A Model Context Protocol (MCP) server that enables Claude Desktop to interact with Lichess chess platform through natural language. Play …☆18Aug 26, 2026Updated last month
- Snowflake Data Engineering in Action☆42Oct 18, 2024Updated last year
- All important Python tools a Data Engineer needs☆31Jun 4, 2024Updated 2 years ago
- ☆23Feb 8, 2023Updated 3 years ago
- This formatter which is for handling parameters and file uploaded to Web API controller.☆26Dec 7, 2022Updated 3 years ago
- Udacity Data Analyst Degree - Project II☆11Sep 25, 2018Updated 8 years ago
- ☆29Jul 20, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repo provides the training and testing code for our paper "A Modular Multimodal Architecture for Gaze Target Prediction: Application…☆25Oct 18, 2022Updated 3 years ago
- ☆21Jul 17, 2023Updated 3 years ago
- Outputs the sentiment for the top 100 subreddits. Also included is a scraper for writing an updated top 100 subreddits to a text file.☆23Mar 18, 2020Updated 6 years ago
- Scalable OLAP system for credit card transaction analysis, leveraging AWS S3, Databricks, and dbt. Features end-to-end batch processing p…☆26Oct 24, 2024Updated last year
- ☆20Jan 2, 2026Updated 9 months ago
- Use of computer vision to detect shoplifting activity and report it into a smart dashboard☆19Oct 16, 2024Updated last year
- A list of useful resources to learn Data Engineering from scratch☆4,031Updated this week