xavier211192 / Xavier-Az-Learn-PySpark-UnitTests
☆13Updated last year
Alternatives and similar repositories for Xavier-Az-Learn-PySpark-UnitTests:
Users that are interested in Xavier-Az-Learn-PySpark-UnitTests are comparing it to the libraries listed below
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆26Updated last year
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆14Updated 10 months ago
- A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …☆20Updated 3 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆95Updated 6 months ago
- Code samples, etc. for Databricks☆63Updated last month
- ☆11Updated 2 years ago
- ☆30Updated 2 months ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆150Updated 6 months ago
- A python SPark ETL libRary (SPETLR) for Databricks. https://discord.gg/p9bzqGybVW☆20Updated this week
- PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows☆41Updated 7 months ago
- streaming eight subreddits from reddit api using kafka producer & spark structured streaming.☆19Updated 3 months ago
- Collection of Sample Databricks Spark Notebooks ( mostly for Azure Databricks )☆84Updated 6 years ago
- This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.☆59Updated 6 months ago
- A very simple "hello world" project for deploying Prefect 2 to a docker container on Google Compute Engine.☆11Updated 2 years ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆34Updated 9 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆26Updated 2 years ago
- ☆14Updated 3 years ago
- Azure Databricks Hands-on (Tutorials)☆65Updated last year
- Data engineering with dbt, published by Packt☆73Updated 11 months ago
- Use Multiple Linear Regression, Python, Pandas, and Matplotlib to analyze the lifetime value and the key factors of the ‘Telco Customer C…☆10Updated 4 years ago
- Spark app to merge different schemas☆23Updated 4 years ago
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆26Updated 2 years ago
- ☆37Updated last year
- devops-for-databricks☆60Updated 8 months ago
- Cost Efficient Data Pipelines with DuckDB☆49Updated 6 months ago
- Template for Data Engineering and Data Pipeline projects☆106Updated 2 years ago
- Data pipeline project using Data Factory, Databricks and Cosmosdb Graph, deployed using Azure DevOps, secured using firewalls and Azure A…☆11Updated 2 years ago
- Delta Lake examples☆217Updated 4 months ago
- ☆76Updated 8 months ago
- ☆28Updated 7 months ago