karlchris / data-engineering

Related projects: ⓘ

• data-engineers-id / basecamp
  where geeks hangout and discuss about data engineering
  ☆39Updated last year
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆225Updated 2 months ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆156Updated 6 months ago
• iobruno / data-engineering-zoomcamp
  Data Engineering examples covering Airflow and Mage for workflows; dbt for BigQuery, Redshift, ClickHouse; Spark and Kafka for Batch/Stre…
  ☆50Updated 3 weeks ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆138Updated 3 months ago
• data-engineers-id / dateng-nongki
  ☆13Updated last year
• zamzambadruzaman / big-data-engineering-indonesia
  A curated list of big data engineering tools, resources and communities.
  ☆30Updated 4 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆89Updated 3 months ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆212Updated 3 months ago
• data-engineering-community / data-engineering-project-template
  This is a template you can use for your next data engineering portfolio project.
  ☆152Updated 3 years ago
• kaoutaar / end-to-end-etl-pipeline-jcdecaux-API
  velib-v2___an ETL pipeline that employs batch and streaming jobs using spark, kafka, airflow, and other tools
  ☆17Updated last week
• josephmachado / online_store
  End to end data engineering project
  ☆49Updated last year
• mage-ai / mage-zoomcamp
  This repository will contain all of the resources for the Mage component of the Data Engineering Zoomcamp: https://github.com/DataTalksCl…
  ☆95Updated last month
• tylerwmarrs / data-engineering-project-doc-templates
  This is project documentation templates derived from CRISP-DM to be used for Data Engineering projects.
  ☆38Updated 3 years ago
• PacktPublishing / Data-Engineering-with-Google-Cloud-Platform
  Data Engineering with Google Cloud Platform, published by Packt
  ☆108Updated last year
• gabriel-garciae / one_billion_row_challenge_python
  ☆17Updated 2 months ago
• developershomes / SparkETL
  Spark all the ETL Pipelines
  ☆29Updated last year
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆47Updated 3 months ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆127Updated 4 years ago
• MarcosMJD / ghcn-d
  Data Pipeline from the Global Historical Climatology Network DataSet
  ☆24Updated last year
• CornelliusYW / Data_Science_Learning_Material
  Collection for your Data Science Learning
  ☆51Updated last week
• mrn-aglic / spark-standalone-cluster
  This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
  ☆22Updated last year
• trannhatnguyen2 / NYC_Taxi_Data_Pipeline
  Nyc_Taxi_Data_Pipeline - DE Project
  ☆62Updated last month
• magogate / DataWarehouse_And_Reporting
  ☆41Updated 3 years ago
• nenalukic / air-quality-project
  ☆8Updated 5 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆35Updated 2 months ago
• DataTalksClub / course-management-platform
  Django-based course management platform for Zoomcamps
  ☆49Updated this week
• InfuseAI / awesome-public-dbt-projects
  A curated list of awesome public DBT projects
  ☆82Updated 8 months ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆54Updated last month
• risingwavelabs / risingwave-data-talks-workshop-2024-03-04
  DataTalks Workshop Materials
  ☆18Updated 6 months ago