PritomDas / Real-Time-Streaming-Data-Pipeline-and-DashboardLinks
Building Real Time Data Pipeline using Apache Kafka, Apache Spark, Hadoop, PostgreSQL, Django and Flexomonster on Docker to track status of Servers in the Data Center across the Globe.
☆22Updated 5 years ago
Alternatives and similar repositories for Real-Time-Streaming-Data-Pipeline-and-Dashboard
Users that are interested in Real-Time-Streaming-Data-Pipeline-and-Dashboard are comparing it to the libraries listed below
Sorting:
- Project for real-time anomaly detection using Kafka and python☆58Updated 3 years ago
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10Updated 2 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Updated last year
- Spark, Airflow, Kafka☆24Updated 2 years ago
- Simple alert system implemented in Kafka and Python☆95Updated 7 years ago
- ☆15Updated 5 years ago
- ☆14Updated 4 years ago
- Kafka variant of the MLOps Level 1 stack☆27Updated 3 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆49Updated 2 years ago
- Synthetic data generation for graph ML experiments☆22Updated 4 years ago
- ☆12Updated 3 years ago
- ☆37Updated 6 years ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆46Updated 2 years ago
- This app allows users to easily query a PDF document using OpenAI's GPT-3 language model in Google Colab, utilizing Google Drive for stor…☆38Updated last year
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆22Updated last year
- Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time☆71Updated 9 years ago
- Stream and process multiple videos in near real time using Kafka. The video frames are processed and a machine learning model does infere…☆64Updated 5 years ago
- Video processing (webcam) in real time using Kafka and Spark.☆25Updated 5 years ago
- code, labs and lectures for the course☆48Updated 2 years ago
- ☆32Updated 2 years ago
- Challenge Data Engineer☆25Updated 3 years ago
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Updated 2 years ago
- ☆11Updated 5 years ago
- Deep Learning model monitoring☆23Updated 5 years ago
- A Kubernetes Hello World Project☆36Updated last year
- "1 config, 1 command from Jupyter Notebook to serve Millions of users", Full-stack On-Premises MLOps system for Computer Vision from Data…☆50Updated last year
- Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)☆197Updated 6 months ago
- Recohut - Learn data engineering, data science☆99Updated 2 years ago
- Streamlit example showing Scikit Learn & Pyspark ML over Healthcare data ! Its simple !!☆31Updated 5 years ago
- Analyzing camera feed using @RedisAI, OpenCV, and Redis plugins for @Grafana☆26Updated 3 years ago