arezamoosavi / AcidOnSpark-ETL

Related projects ⓘ

Alternatives and complementary repositories for AcidOnSpark-ETL

• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆246Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆51Updated 2 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆143Updated 5 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆208Updated last month
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆50Updated 3 months ago
• yTek01 / docker-spark-airflow
  ☆32Updated last year
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 3 years ago
• astronomer / cosmos-demo
  Demo DAGs that show how to run dbt Core in Airflow using Cosmos
  ☆46Updated last month
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆166Updated 8 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆92Updated 5 months ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆57Updated last year
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆113Updated last year
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆41Updated 3 months ago
• SebasMBK / SunglassesHubETL
  This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process
  ☆45Updated last year
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆58Updated last year
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆113Updated 4 months ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆28Updated 8 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 5 months ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆104Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆40Updated this week
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆42Updated last year
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆38Updated 4 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆86Updated last month