SeanHorner / sparkLinks
A repository of Apache Spark projects, training projects, and tutorials, in both Scala and Python.
☆31Updated 3 years ago
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below
Sorting:
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆84Updated 5 years ago
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆148Updated last year
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆103Updated 4 years ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆157Updated 10 months ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆96Updated 3 months ago
- Learn PySpark from Basics to Advanced. Checkout the YouTube Series : [PySpark - Zero to Hero]☆61Updated 5 months ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆48Updated 5 years ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆144Updated last year
- Data Engineering YouTube Analysis Project by Darshil Parmar☆195Updated last year
- Resources for the free AWS Data Engineering course on youtube☆100Updated 3 years ago
- PySpark Projects☆23Updated 3 weeks ago
- Udacity Data Engineering Nanodegree Capstone Project☆36Updated 5 years ago
- ☆14Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆23Updated 2 years ago
- This repo is mostly created for pyspark and hive related interview questions.☆47Updated 3 years ago
- ☆87Updated 2 years ago
- ☆284Updated 10 months ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆106Updated 2 years ago
- YouTube tutorial project☆104Updated last year
- 🐍 Quick reference guide to common patterns & functions in PySpark.☆564Updated 2 years ago
- ☆151Updated 3 years ago
- ☆51Updated last year
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆91Updated 5 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆99Updated 11 months ago
- ☆65Updated last month
- ☆21Updated last year
- Repository related to Spark SQL and Pyspark using Python3☆38Updated 3 years ago
- apache-spark-with-databricks-for-data-engineering☆88Updated 11 months ago
- All Data Engineering notebooks from Datacamp course☆115Updated 5 years ago
- Public Docker Images for popular services☆34Updated 3 months ago