tomaztk / Spark-for-data-engineers
Apache Spark for data engineers
☆55Updated 2 years ago
Alternatives and similar repositories for Spark-for-data-engineers:
Users that are interested in Spark-for-data-engineers are comparing it to the libraries listed below
- Azure Databricks - Advent of 2020 Blogposts☆60Updated 2 years ago
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆70Updated 9 months ago
- Data engineering with dbt, published by Packt☆76Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 7 months ago
- Code for "Advanced data transformations in SQL" free live workshop☆74Updated 4 months ago
- End to end data engineering project☆53Updated 2 years ago
- A tutorial for the Great Expectations library.☆69Updated 4 years ago
- ☆87Updated 2 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆95Updated 7 months ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆100Updated 4 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆36Updated 7 months ago
- Sample project to demonstrate data engineering best practices☆179Updated last year
- Data engineering project using UK Bus Open Data Service (BODS) to calculate late buses in real-time for any selected region in England. P…☆28Updated last year
- This is a code repository for the course Data Engineering with Data Build Tool (DBT).☆50Updated 6 months ago
- Data Engineering with Google Cloud Platform, published by Packt☆113Updated last year
- ☆122Updated last month
- This repo will guide you step-by-step method to create star schema dimensional model.☆25Updated 3 years ago
- This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering so…☆22Updated last year
- Snowflake Cookbook, published by Packt☆77Updated 2 years ago
- Template for Data Engineering and Data Pipeline projects☆108Updated 2 years ago
- Data Engineering with Spark and Delta Lake☆96Updated 2 years ago
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆257Updated 8 months ago
- ☆178Updated 4 years ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆76Updated 5 years ago
- An End-to-End ETL data pipeline that leverages pyspark parallel processing to process about 25 million rows of data coming from a SaaS ap…☆25Updated 2 years ago
- Data Modeling with Snowflake, published by Packt☆63Updated last year
- ☆21Updated last year
- Apache Airflow Best Practices, published by Packt☆37Updated 4 months ago
- Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution☆66Updated 4 years ago
- Ravi Azure ADB ADF Repository☆65Updated last month