zhujun98 / data-engineering

Related projects ⓘ

Alternatives and complementary repositories for data-engineering

• immu0001 / Udacity-Data-Engineer-nanodegree
  Classwork projects and home works done through Udacity data engineering nano degree
  ☆74Updated 11 months ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆21Updated 6 years ago
• guoliveira / data-engineer-zoomcamp-project
  ☆36Updated last year
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆43Updated 5 years ago
• IremErturk / dtc-de-capstone-project
  ☆11Updated 2 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆99Updated 3 years ago
• JesusAcuna / data-engineering-project
  ☆27Updated last year
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆51Updated 2 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆42Updated 2 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 5 months ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆21Updated last year
• kroudir / Data-Engineer-Nanodegree-Projects-Udacity
  Projects done in the Data Engineer Nanodegree Program by Udacity.com
  ☆94Updated last year
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆23Updated 11 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆92Updated 5 months ago
• shravan-kuchkula / udacity-data-eng-proj4
  Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …
  ☆16Updated 5 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆133Updated 4 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆51Updated 2 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆119Updated last year
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆80Updated 5 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆38Updated 4 months ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆50Updated 3 months ago
• VicenteYago / steam-data-engineering
  A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!
  ☆22Updated 2 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 5 years ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆32Updated 11 months ago
• yennanliu / DE-100-days
  data engineering 100 days 🤖 🧲 🦾 | #DE
  ☆37Updated last year
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆35Updated last year
• sparsh-ai / recohut
  Recohut - Learn data engineering, data science
  ☆93Updated last year