Alternatives and similar repositories for Apache-Spark-Guide

Users that are interested in Apache-Spark-Guide are comparing it to the libraries listed below

• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆57Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆56Updated 2 years ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆116Updated 3 years ago
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆141Updated 5 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆162Updated 5 years ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆76Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆78Updated 2 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 5 years ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆53Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆60Updated last year
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆183Updated 4 years ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆66Updated 5 years ago
• Snowflake-Labs / awesome-snowflake
  A curated list of resources about Snowflake
  ☆256Updated last year
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 7 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆168Updated 2 years ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆89Updated 9 months ago
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆225Updated 9 months ago
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆28Updated 3 years ago
• delta-incubator / delta-lake-definitive-guide
  ☆60Updated last year
• garystafford / aws-airflow-demo
  Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…
  ☆41Updated 3 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆97Updated 6 years ago
• Nunie123 / data_engineering_on_gcp_book
  A book describing how to set up and maintain Data Engineering infrastructure using Google Cloud Platform.
  ☆126Updated 4 years ago
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆116Updated 5 years ago
• dbt-labs / dbt-starter-project
  Cloned by the `dbt init` task
  ☆62Updated last year
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated last year
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆91Updated 2 years ago
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆96Updated last year
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆90Updated 4 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago