This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
☆105Sep 26, 2025Updated last year
Alternatives and similar repositories for ApacheSpark
Users that are interested in ApacheSpark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆17Dec 18, 2018Updated 7 years ago
- Leetcode SQL Solutions☆202Aug 26, 2023Updated 3 years ago
- PySpark Cheatsheet☆36Jan 18, 2023Updated 3 years ago
- ☆15Jan 17, 2022Updated 4 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The 6 most window functions in PySpark - based on my blog post☆12Dec 15, 2023Updated 2 years ago
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆17Sep 13, 2020Updated 6 years ago
- Ravi Azure ADB ADF Repository☆65Jan 25, 2025Updated last year
- Jupyter Notebook showing how to process Telecom datasets using PySpark (SparkSQL and DataFrames) and plotting the results using Matplotli…☆17Dec 3, 2018Updated 7 years ago
- Collection of Databricks and Jupyter Notebooks☆22Feb 9, 2026Updated 8 months ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆56May 6, 2023Updated 3 years ago
- PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster☆501Oct 15, 2024Updated 2 years ago
- This repository contains code for Spark Streaming☆27Mar 11, 2021Updated 5 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Basic framework utilities to quickly start writing production ready Apache Spark applications☆36Dec 15, 2024Updated last year
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…☆58Oct 20, 2022Updated 4 years ago
- Repository related to Spark SQL and Pyspark using Python3☆42Jun 12, 2022Updated 4 years ago
- Reusable Python classes that extend open source PySpark capabilities. Examples of implementation is available under notebooks of repo htt…☆13Nov 1, 2024Updated 2 years ago
- Develop ML models predict taxi trip duration in NYC. Ranked : Top 6% | RMSLE : 0.377 (Kaggle) | #DS☆17Jan 7, 2023Updated 3 years ago
- ☆13Oct 26, 2026Updated last week
- This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.☆20Feb 19, 2023Updated 3 years ago
- ☆28Jun 14, 2022Updated 4 years ago
- Repository for Microsoft Databricks Training Events - Hosted by BlueGranite☆15Aug 22, 2019Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆30Apr 12, 2023Updated 3 years ago
- Slides and demo files from community presentations☆18Oct 11, 2026Updated 3 weeks ago
- Managing machine learning life-cycle with MLflow tutorial☆24May 1, 2023Updated 3 years ago
- Notes and code from a network biology study group at UMD.☆10Apr 11, 2015Updated 11 years ago
- Apache Spark using SQL☆14Aug 18, 2021Updated 5 years ago
- ☆10Nov 17, 2021Updated 4 years ago
- Public Docker Images for popular services☆59Sep 13, 2026Updated last month
- dbt sample project for Snowflake using the `TPCH` dataset that ships as a shared database with Snowflake.☆21Apr 5, 2022Updated 4 years ago
- A four-day course on Python, the Scientific Python stack and PySpark, adapted from a training course I gave to one of our clients in Dece…☆10Feb 3, 2016Updated 10 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Contains spark dataframe solutions of leetcode questions☆24Dec 13, 2022Updated 3 years ago
- An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit☆20Aug 5, 2022Updated 4 years ago
- Complete SQL Project for data analysis with source code.☆376Oct 11, 2022Updated 4 years ago
- Dockerizing an Apache Spark Standalone Cluster☆42Jun 29, 2022Updated 4 years ago
- An application to interact with your FHIR API's using natural language query☆16Jul 6, 2023Updated 3 years ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- Python scripts to convert and unpack mainframe EBCDIC data on the cloud or any ASCII environment.☆45Aug 25, 2025Updated last year