PritomDas / Real-Time-Streaming-Data-Pipeline-and-DashboardLinks
Building Real Time Data Pipeline using Apache Kafka, Apache Spark, Hadoop, PostgreSQL, Django and Flexomonster on Docker to track status of Servers in the Data Center across the Globe.
☆22Updated 5 years ago
Alternatives and similar repositories for Real-Time-Streaming-Data-Pipeline-and-Dashboard
Users that are interested in Real-Time-Streaming-Data-Pipeline-and-Dashboard are comparing it to the libraries listed below
Sorting:
- Project for real-time anomaly detection using Kafka and python☆59Updated 3 years ago
- ☆37Updated 6 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Updated last year
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆47Updated 2 years ago
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10Updated 2 years ago
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆17Updated 5 years ago
- ☆12Updated 3 years ago
- Synthetic data generation for graph ML experiments☆22Updated 4 years ago
- Kafka variant of the MLOps Level 1 stack☆27Updated 3 years ago
- ☆15Updated 5 years ago
- Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time☆71Updated 9 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆37Updated 6 years ago
- Spark, Airflow, Kafka☆24Updated 2 years ago
- ☆11Updated 5 years ago
- Simple alert system implemented in Kafka and Python☆95Updated 7 years ago
- This app allows users to easily query a PDF document using OpenAI's GPT-3 language model in Google Colab, utilizing Google Drive for stor…☆38Updated last year
- This is code depository for my upcoming session. Will update details post the session☆40Updated 3 years ago
- Using a feature store to connect the DataOps and MLOps workflows to enable collaborative teams to develop efficiently.☆57Updated 3 years ago
- A Mathematics helper for humans 🦖☆10Updated 4 years ago
- Automatic tagging of clothing in E-Commerce, Using Tensorflow and GCP. Classify the clothing products into various categories using Machi…☆55Updated 7 years ago
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Updated 2 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆49Updated 2 years ago
- Making Machine Learning Simple and Scalable with Python, Jupyter Notebook, TensorFlow, Keras, Apache Kafka and KSQL☆97Updated 7 years ago
- ☆32Updated 5 years ago
- This research goal is to build binary classifier model which are able to separate fraud transactions from non-fraud transactions.☆21Updated 2 years ago
- Video processing (webcam) in real time using Kafka and Spark.☆25Updated 5 years ago
- This repo gives an introduction to setting up streaming analytics using open source technologies☆25Updated 2 years ago
- RTD telemetry feed☆35Updated 2 years ago
- Content related to Mastering Postgresql along with videos.☆18Updated 4 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Updated 2 years ago