divakaivan / transaction-stream-data-pipeline

Related projects ⓘ

Alternatives and complementary repositories for transaction-stream-data-pipeline

• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆239Updated last month
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆41Updated 3 months ago
• kaoutaar / end-to-end-etl-pipeline-jcdecaux-API
  velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…
  ☆18Updated 2 months ago
• nama1arpit / reddit-streaming-pipeline
  A real-time reddit data streaming pipeline for sentiment analysis of various subreddits
  ☆102Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆91Updated 4 months ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆29Updated 2 weeks ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆65Updated 3 weeks ago
• carterchene / flink-streaming-demo
  This is a demo streaming project simulating a music streaming service.
  ☆26Updated 2 months ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆46Updated 3 months ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆164Updated 8 months ago
• dagster-io / project-dagster-university
  an ephemeral project repo for the DU Dagster project
  ☆52Updated last week
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆38Updated this week
• data-catering / insta-infra
  Quickstart for any service
  ☆129Updated this week
• josephmachado / change_data_capture
  Repo for CDC with debezium blog post
  ☆26Updated last month
• EcZachly / video-game-training-sql
  Hey this is the repo that has all the queries and data for my video game training series!
  ☆130Updated 2 years ago
• vajol / python-data-engineering-resources
  A handpicked collection of resources for Python developers in data engineering, machine learning, and AI. Inside, you'll discover a neatl…
  ☆76Updated 7 months ago
• davidzajac1 / zillacode
  Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake
  ☆100Updated 2 months ago
• abdkumar / spotify-stream-analytics
  Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consu…
  ☆66Updated 10 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆237Updated 4 months ago
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆89Updated 2 years ago
• josephmachado / data-engineering-interview-series
  Repository for Data Engineering Interview Series
  ☆21Updated 3 weeks ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆70Updated 4 months ago
• JesusAcuna / data-engineering-project
  ☆27Updated 11 months ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆49Updated 3 months ago
• stevenhurwitt / reddit-streaming
  streaming eight subreddits from reddit api using kafka producer & spark structured streaming.
  ☆19Updated last week
• seacevedo / Solana-Pipeline
  Data Engineering Project to Extract and Process Solana Reddit Data
  ☆22Updated 9 months ago
• bbrewington / data-tools
  ☆23Updated this week
• airbytehq / quickstarts
  ☆190Updated 2 weeks ago
• airscholar / realtime-voting-data-engineering
  This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…
  ☆29Updated 11 months ago