PritomDas / Real-Time-Streaming-Data-Pipeline-and-DashboardLinks
Building Real Time Data Pipeline using Apache Kafka, Apache Spark, Hadoop, PostgreSQL, Django and Flexomonster on Docker to track status of Servers in the Data Center across the Globe.
☆20Updated 4 years ago
Alternatives and similar repositories for Real-Time-Streaming-Data-Pipeline-and-Dashboard
Users that are interested in Real-Time-Streaming-Data-Pipeline-and-Dashboard are comparing it to the libraries listed below
Sorting:
- Project for real-time anomaly detection using Kafka and python☆58Updated 2 years ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆44Updated last year
- Spark, Airflow, Kafka☆26Updated 2 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆31Updated last year
- ☆12Updated 3 years ago
- ☆14Updated 5 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆31Updated last year
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆16Updated 4 years ago
- An end-to-end workflow for processing streaming data on Azure.☆15Updated 8 months ago
- Udacity Data Streaming Nanodegree Program☆22Updated 4 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆35Updated last year
- ☆11Updated 4 years ago
- ☆33Updated last year
- ☆40Updated 11 months ago
- The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…☆27Updated 2 years ago
- Implement rest api service for manipulating blog contents using FastAPI in Python☆12Updated 2 years ago
- Streamlit example showing Scikit Learn & Pyspark ML over Healthcare data ! Its simple !!☆30Updated 4 years ago
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Updated last year
- Kafka variant of the MLOps Level 1 stack☆24Updated 3 years ago
- PySpark Cheatsheet☆36Updated 2 years ago
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆36Updated last year
- Simple alert system implemented in Kafka and Python☆95Updated 6 years ago
- ☆87Updated 2 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆46Updated last year
- The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a compl…☆14Updated last year
- Content related to Mastering Postgresql along with videos.☆15Updated 3 years ago
- ☆10Updated 3 years ago
- A Postgres data warehouse for processing synthetic data using IAC principles☆17Updated 2 years ago
- End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.☆9Updated last year
- ITMD - 526 Data Warehousing☆27Updated 9 years ago