This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
☆105Sep 26, 2025Updated 11 months ago
Alternatives and similar repositories for ApacheSpark
Users that are interested in ApacheSpark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Airflow & DBT Cloud Integrated Project Presented at Lagos DBT Community Meetup & DataFestAfrica 23☆13Oct 11, 2023Updated 2 years ago
- Leetcode SQL Solutions☆196Aug 26, 2023Updated 3 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- PySpark Cheatsheet☆36Jan 18, 2023Updated 3 years ago
- Jupyter Notebook showing how to process Telecom datasets using PySpark (SparkSQL and DataFrames) and plotting the results using Matplotli…☆17Dec 3, 2018Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆17Sep 13, 2020Updated 5 years ago
- Ravi Azure ADB ADF Repository☆65Jan 25, 2025Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆56May 6, 2023Updated 3 years ago
- pyspark dataframe made easy☆16Dec 15, 2021Updated 4 years ago
- PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster☆498Oct 15, 2024Updated last year
- This repository contains code for Spark Streaming☆26Mar 11, 2021Updated 5 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…☆58Oct 20, 2022Updated 3 years ago
- Reusable Python classes that extend open source PySpark capabilities. Examples of implementation is available under notebooks of repo htt…☆13Nov 1, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆28Jun 14, 2022Updated 4 years ago
- This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.☆20Feb 19, 2023Updated 3 years ago
- This repo contains commands that data engineers use in day to day work.☆64Feb 4, 2023Updated 3 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆30Apr 12, 2023Updated 3 years ago
- Case Study's from Danny Ma's Serious SQL Course☆19Aug 4, 2022Updated 4 years ago
- Repository for Microsoft Databricks Training Events - Hosted by BlueGranite☆16Aug 22, 2019Updated 7 years ago
- Template for Scala Spark with Unit Test☆13Jul 24, 2023Updated 3 years ago
- Apache Spark Interview Question and Answers☆21Oct 13, 2020Updated 5 years ago
- I implemented various ETL processes like loading the data using sqoop from mysql to hdfs, transform the data using Spark and Scala, perfo…☆10Oct 20, 2017Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Databricks Platform - Architecture, Security, Automation and much more!!☆57Aug 17, 2026Updated 2 weeks ago
- Some Windows images for tool images that I had to use in a Windows Environment.☆10Sep 27, 2020Updated 5 years ago
- dbt sample project for Snowflake using the `TPCH` dataset that ships as a shared database with Snowflake.☆21Apr 5, 2022Updated 4 years ago
- Contains spark dataframe solutions of leetcode questions☆24Dec 13, 2022Updated 3 years ago
- An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit☆20Aug 5, 2022Updated 4 years ago
- End to end data engineering project☆59Oct 27, 2022Updated 3 years ago
- Complete SQL Project for data analysis with source code.☆377Oct 11, 2022Updated 3 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- An application to interact with your FHIR API's using natural language query☆16Jul 6, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- ☆95Sep 14, 2022Updated 3 years ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆55Sep 30, 2023Updated 2 years ago
- ☆12Feb 23, 2022Updated 4 years ago
- Mastering AWS CloudFormation Second Edition, published by packt☆18Oct 23, 2023Updated 2 years ago
- With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…☆15Jan 4, 2026Updated 7 months ago
- Azure Databricks - Advent of 2020 Blogposts☆64Sep 22, 2022Updated 3 years ago