ahmed-gharib89 / flights-delta-lakeLinks
☆10Updated 2 years ago
Alternatives and similar repositories for flights-delta-lake
Users that are interested in flights-delta-lake are comparing it to the libraries listed below
Sorting:
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- ☆87Updated 2 years ago
- A curated list of awesome Databricks resources, including Spark☆20Updated last year
- data engineering 100 days 🤖 🧲 🦾 | #DE☆39Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆71Updated last year
- An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS ap…☆25Updated 2 years ago
- Examples surrounding Databricks.☆59Updated 11 months ago
- Recohut - Learn data engineering, data science☆97Updated last year
- 🧱 A collection of supplementary utilities and helper notebooks to perform admin tasks on Databricks☆56Updated this week
- Processing TfL data for bike usage with Google Cloud Platform.☆45Updated 2 years ago
- PySpark Cheatsheet☆36Updated 2 years ago
- Stream processing with Azure Databricks☆138Updated 6 months ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 10 months ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆147Updated 5 years ago
- New generation opensource data stack☆69Updated 3 years ago
- Spark, Airflow, Kafka☆26Updated 2 years ago
- how to unit test your PySpark code☆29Updated 4 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Updated 9 months ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆99Updated 11 months ago
- Code snippets for Data Engineering Design Patterns book☆122Updated 3 months ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆84Updated 2 years ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆142Updated 11 months ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- Spark data pipeline that processes movie ratings data.☆28Updated last week
- ☆86Updated 2 years ago
- Data engineering interviews Q&A for data community by data community☆63Updated 5 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆38Updated 11 months ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago