PritomDas / Real-Time-Streaming-Data-Pipeline-and-DashboardLinks
Building Real Time Data Pipeline using Apache Kafka, Apache Spark, Hadoop, PostgreSQL, Django and Flexomonster on Docker to track status of Servers in the Data Center across the Globe.
☆20Updated 4 years ago
Alternatives and similar repositories for Real-Time-Streaming-Data-Pipeline-and-Dashboard
Users that are interested in Real-Time-Streaming-Data-Pipeline-and-Dashboard are comparing it to the libraries listed below
Sorting:
- Project for real-time anomaly detection using Kafka and python☆58Updated 2 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆32Updated last year
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10Updated 2 years ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆44Updated last year
- ☆33Updated last year
- Spark, Airflow, Kafka☆26Updated 2 years ago
- Source code for the Apache Kafka in Python video series☆19Updated 3 years ago
- ☆12Updated 3 years ago
- ☆14Updated 3 years ago
- Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time☆71Updated 8 years ago
- ☆11Updated 4 years ago
- ☆37Updated 5 years ago
- Pair: image-based product collection recommender☆19Updated 5 years ago
- Udacity Data Streaming Nanodegree Program☆22Updated 4 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆47Updated last year
- Synthetic data generation for graph ML experiments☆22Updated 4 years ago
- ☆41Updated last year
- This repo gives an introduction to setting up streaming analytics using open source technologies☆25Updated 2 years ago
- This research goal is to build binary classifier model which are able to separate fraud transactions from non-fraud transactions.☆14Updated last year
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆22Updated last year
- ☆15Updated 5 years ago
- Using a feature store to connect the DataOps and MLOps workflows to enable collaborative teams to develop efficiently.☆57Updated 2 years ago
- Explore Multiple Vector Databases and chat with documents on Multiple LLM models, private LLM models☆48Updated 2 years ago
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Updated 2 years ago
- Simple alert system implemented in Kafka and Python☆97Updated 7 years ago
- Video processing (webcam) in real time using Kafka and Spark.☆25Updated 4 years ago
- Challenge Data Engineer☆25Updated 3 years ago
- MLFlow End to End Workshop at Chandigarh University☆11Updated 2 years ago
- Implement rest api service for manipulating blog contents using FastAPI in Python☆12Updated 2 years ago
- ☆11Updated last year