PritomDas / Real-Time-Streaming-Data-Pipeline-and-DashboardLinks
Building Real Time Data Pipeline using Apache Kafka, Apache Spark, Hadoop, PostgreSQL, Django and Flexomonster on Docker to track status of Servers in the Data Center across the Globe.
☆21Updated 4 years ago
Alternatives and similar repositories for Real-Time-Streaming-Data-Pipeline-and-Dashboard
Users that are interested in Real-Time-Streaming-Data-Pipeline-and-Dashboard are comparing it to the libraries listed below
Sorting:
- Project for real-time anomaly detection using Kafka and python☆58Updated 2 years ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆44Updated last year
- Spark, Airflow, Kafka☆26Updated 2 years ago
- ☆36Updated 5 years ago
- ☆15Updated 5 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Updated last year
- Implement rest api service for manipulating blog contents using FastAPI in Python☆12Updated 2 years ago
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10Updated 2 years ago
- The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big d…☆37Updated 6 years ago
- This repo gives an introduction to setting up streaming analytics using open source technologies☆25Updated 2 years ago
- A data pipeline with Kafka, Spark Streaming, dbt, Docker, Airflow, and GCP!☆12Updated 2 years ago
- ☆12Updated 3 years ago
- Challenge Data Engineer☆25Updated 3 years ago
- ☆44Updated last year
- Recohut - Learn data engineering, data science☆99Updated 2 years ago
- NLP/LLM Mlops Pipeline to dev/train/evaluation, scalable deploy and monitoring systems.☆22Updated last year
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆63Updated 2 years ago
- A Postgres data warehouse for processing synthetic data using IAC principles☆19Updated 2 years ago
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆48Updated last year
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆37Updated 2 years ago
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆17Updated 5 years ago
- Source code for the Apache Kafka in Python video series☆19Updated 3 years ago
- Kafka variant of the MLOps Level 1 stack☆25Updated 3 years ago
- ☆47Updated 2 years ago
- Data warehouse implementation for an e-commerce website “Infibeam” that sells digital and consumer electronics.☆20Updated 7 years ago
- Udacity Data Engineering Nanodegree Program☆52Updated 4 years ago
- A Kubernetes Hello World Project☆37Updated 8 months ago
- Build Deep Neural Network model in Keras and deploy a REST API to production with Flask on Google App Engine☆33Updated 2 years ago
- ☆11Updated 4 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆35Updated last year