Alternatives and similar repositories for posts

Users that are interested in posts are comparing it to the libraries listed below

• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆143Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆44Updated last year
• mharty3 / energy_data_capstone
  ☆36Updated 2 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆56Updated 2 years ago
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆120Updated 3 months ago
• Kevin-Nduati / My-Spotify-Wrapped
  I will attempt to create my own spotify wrapped by collecting data from the spotify API, perform transformations and create informative d…
  ☆73Updated 2 years ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆23Updated 3 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆46Updated 3 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆64Updated 2 years ago
• EcZachly / video-game-training-sql
  Hey this is the repo that has all the queries and data for my video game training series!
  ☆154Updated 3 years ago
• mydgd / snowflake-table-catalog
  Streamlit application to explore Snowflake Tables
  ☆46Updated 2 years ago
• noahgift / data-engineering-and-dataops
  Duke MIDS: Data Engineering and DataOps Course
  ☆67Updated 9 months ago
• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆24Updated 3 years ago
• risingwavelabs / risingwave-data-talks-workshop-2024-03-04
  DataTalks Workshop Materials
  ☆19Updated last year
• khuyentran1401 / customer_segmentation
  An end-to-end project on customer segmentation
  ☆83Updated 2 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆47Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆256Updated 7 months ago
• noahgift / databricks-zero-to-mlops
  ☆28Updated 3 years ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆29Updated 4 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 4 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 6 years ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆161Updated 2 months ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆86Updated 6 months ago
• jamesdensmore / datapipelinesbook
  ☆191Updated 4 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆59Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 3 years ago
• Aiven-Labs / python-notebooks-for-apache-kafka
  A Series of Notebooks on how to start with Kafka and Python
  ☆152Updated 8 months ago
• Wittline / uber-expenses-tracking
  The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …
  ☆122Updated 3 years ago