Alternatives and similar repositories for Apache-Spark-Guide:

Users that are interested in Apache-Spark-Guide are comparing it to the libraries listed below

• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆27Updated 2 years ago
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆27Updated 2 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆23Updated 10 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆54Updated last year
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆56Updated 8 months ago
• josephmachado / simple_polars_etl
  ☆16Updated 11 months ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆143Updated 4 years ago
• shravan-kuchkula / dataEngineering
  A repo to track data engineering projects
  ☆13Updated 2 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆51Updated 4 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆136Updated 5 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆80Updated last month
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆21Updated 7 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆44Updated 6 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆100Updated 10 months ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆52Updated 3 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 5 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆54Updated 2 years ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆60Updated 2 years ago
• danielbeach / DataEngineeringProjects
  Some example projects for Data Engineers to build, end-to-end.
  ☆28Updated last year
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆22Updated 2 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆114Updated 5 years ago
• reisdebora / awesome-databricks
  A curated list of awesome Databricks resources, including Spark
  ☆17Updated 9 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆40Updated 9 months ago
• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated last year
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆109Updated 2 years ago
• Snowflake-Labs / awesome-snowflake
  A curated list of resources about Snowflake
  ☆236Updated last year
• tatwan / airflow-spark-aws-emr
  ☆12Updated 4 years ago
• josephmachado / data_engineering_best_practices_log
  Code to demonstrate data engineering metadata & logging best practices
  ☆16Updated last year