jaumpedro214 / traffic-flow-spark-kafka

Related projects: ⓘ

• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆41Updated last month
• josephmachado / online_store
  End to end data engineering project
  ☆49Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆89Updated 3 months ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆35Updated 2 months ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 3 months ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆50Updated 2 years ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆39Updated 2 years ago
• carterchene / flink-streaming-demo
  This is a demo streaming project simulating a music streaming service.
  ☆23Updated last month
• jmeisele / ml-ops-kafka
  Kafka variant of the MLOps Level 1 stack
  ☆22Updated 2 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆36Updated 11 months ago
• guoliveira / data-engineer-zoomcamp-project
  ☆35Updated last year
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆42Updated last year
• rodrigo-arenas / kafkaml-anomaly-detection
  Project for real-time anomaly detection using Kafka and python
  ☆55Updated last year
• team-data-science / aws-data-engineering
  Course Material Data Engineering on AWS Course
  ☆26Updated last week
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆47Updated last month
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆26Updated last month
• rafaelvp-db / databricks-end-to-end-streaming
  End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.
  ☆9Updated 6 months ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆56Updated last year
• JesusAcuna / data-engineering-project
  ☆27Updated 10 months ago
• itversity / data-engineering-spark
  ☆84Updated 2 years ago
• yTek01 / docker-spark-airflow
  ☆30Updated last year
• eeeds / employees-attrition-mlops
  Final Project of the MLOps Zoomcamp hosted by DataTalksClub.
  ☆26Updated last year
• pran4ajith / spark-twitter-streaming
  A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…
  ☆29Updated 4 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆69Updated 3 months ago
• damklis / etljob
  Simple ETL pipeline using Python
  ☆20Updated last year
• RyanEricLamb / data-engineering-bus-tracker
  Data engineering project using UK Bus Open Data Service (BODS) to calculate late buses in real-time for any selected region in England. P…
  ☆26Updated last year
• trannhatnguyen2 / NYC_Taxi_Data_Pipeline
  Nyc_Taxi_Data_Pipeline - DE Project
  ☆62Updated last month
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆20Updated 2 years ago
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆20Updated last year
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 2 years ago