jaumpedro214 / posts

Related projects: ⓘ

• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆20Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆35Updated 2 months ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆54Updated last month
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆47Updated last month
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆47Updated 3 months ago
• EcZachly-Inc-Second-Boot-Camp / 7-llm-driven-data-engineering
  This is a public repository to go over all the LLM-driven data engineering concepts.
  ☆67Updated 11 months ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆156Updated 6 months ago
• itversity / data-engineering-spark
  ☆84Updated 2 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆125Updated last year
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆54Updated last month
• mharty3 / energy_data_capstone
  ☆29Updated last year
• jamesdensmore / datapipelinesbook
  ☆164Updated 3 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆36Updated 11 months ago
• 10Kang / DE_Zoomcamp2024_ZY
  Repository for Data Engineering Zoomcamp 2024
  ☆13Updated 5 months ago
• team-data-science / aws-data-engineering
  Course Material Data Engineering on AWS Course
  ☆26Updated last week
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆138Updated 3 months ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆42Updated 11 months ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆98Updated 3 years ago
• itversity / databricks-certification-spark
  Databricks Certified Associate Spark Developer preparation toolkit to setup single node Standalone Spark Cluster along with material in t…
  ☆28Updated 5 months ago
• trannhatnguyen2 / NYC_Taxi_Data_Pipeline
  Nyc_Taxi_Data_Pipeline - DE Project
  ☆62Updated last month
• sidharth1805 / Spotify_etl
  ☆123Updated last year
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆54Updated last year
• JesusAcuna / data-engineering-project
  ☆27Updated 10 months ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Professional
  The resources of the preparation course for Databricks Data Engineer Professional certification exam
  ☆73Updated 9 months ago
• Wittline / data-engineer-challenge
  Challenge Data Engineer
  ☆25Updated 2 years ago
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆87Updated 2 years ago
• guoliveira / data-engineer-zoomcamp-project
  ☆35Updated last year
• shivampanicker / cicd_with_databricks
  ☆32Updated 9 months ago
• PacktPublishing / Data-Engineering-with-AWS-2nd-edition
  Data Engineering with AWS, 2nd edition - Published by Packt
  ☆95Updated 10 months ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆102Updated last month