ahmed-gharib89 / flights-delta-lake
☆9Updated 2 years ago
Alternatives and similar repositories for flights-delta-lake:
Users that are interested in flights-delta-lake are comparing it to the libraries listed below
- data engineering 100 days 🤖 🧲 🦾 | #DE☆40Updated last year
- Full stack data engineering tools and infrastructure set-up☆47Updated 3 years ago
- Data engineering interviews Q&A for data community by data community☆62Updated 4 years ago
- Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…☆28Updated 9 months ago
- ☆10Updated 2 years ago
- Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution☆19Updated 4 years ago
- Spark data pipeline that processes movie ratings data.☆27Updated this week
- A curated list of awesome Databricks resources, including Spark☆16Updated 6 months ago
- Delta Lake Documentation☆48Updated 7 months ago
- Pyspark boilerplate for running prod ready data pipeline☆28Updated 3 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆95Updated 5 months ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Spark app to merge different schemas☆23Updated 4 years ago
- PySpark Cheatsheet☆36Updated 2 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Updated 3 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆25Updated 2 years ago
- Template for Data Engineering and Data Pipeline projects☆106Updated 2 years ago
- Yet Another (Spark) ETL Framework☆18Updated last year
- Cloned by the `dbt init` task☆60Updated 8 months ago
- ☆22Updated 2 years ago
- Data pipeline project using Data Factory, Databricks and Cosmosdb Graph, deployed using Azure DevOps, secured using firewalls and Azure A…☆11Updated 2 years ago
- how to unit test your PySpark code☆28Updated 3 years ago
- ☆25Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆54Updated 5 months ago
- ☆33Updated 8 months ago
- Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution☆66Updated 4 years ago
- Resources for the Udemy Course - Azure Databricks & Spark Core For Data Engineers(Python/SQL) by Ramesh Retnasamy☆25Updated 4 months ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Code snippets for Data Engineering Design Patterns book☆49Updated 2 weeks ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆36Updated 6 months ago