This project implements a real-time data pipeline using Apache Kafka, Python's psutil library for metric collection, and SQL Server for data storage. The pipeline collects metrics data from the local computer, processes it through Kafka brokers, and loads it into a SQL Server database. Additionally, a real-time dashboard is created using Power B…
☆17Oct 31, 2023Updated 3 years ago
Alternatives and similar repositories for Real-Time-Data-Pipeline-Using-Kafka
Users that are interested in Real-Time-Data-Pipeline-Using-Kafka are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. T…☆28Apr 15, 2024Updated 2 years ago
- The project aims to automate the extraction of data from a YouTube channel, transform the data into a suitable format, and make it availa…☆12Sep 24, 2023Updated 3 years ago
- Compiler design project for UE19CS351 @ PES University - documentation and project outline☆11May 3, 2022Updated 4 years ago
- This file contains advanced excel formulas and functions like Vlookup with match function, index and match function, offset & counta, log…☆11Feb 4, 2021Updated 5 years ago
- My personal knowledge-base.☆17Jul 19, 2026Updated 3 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- This is the dashboard to see the system information. The code will use Python 3.11, Flask and psutil module to create this dashboard.☆12Nov 15, 2022Updated 3 years ago
- This project demonstrates real-time data streaming and processing architecture using Kafka, Spark Streaming, and Debezium for capturing C…☆19Oct 24, 2024Updated 2 years ago
- IPM-LSTM: A Learning-Based Interior Point Method for Solving Nonlinear Programs☆14Oct 23, 2025Updated last year
- Python-written project that utilizes Time Series analysis, along with a Linear Regression model, to forecast the price of the Japanese Ye…☆10Jan 22, 2021Updated 5 years ago
- Homeworks and codes for CTU OI☆12Dec 15, 2023Updated 2 years ago
- PyData London 2022 sktime workshop☆11Aug 21, 2023Updated 3 years ago
- 《从原理到实战：掌握 MCP》系列文章的示例代码库☆13May 6, 2025Updated last year
- A repository for Mini Project of Compiler Design, 6th Sem, Computer Science, PES University.☆13May 21, 2020Updated 6 years ago
- A rich and diverse dataset created with GPT-4 for training and evaluating conversational models in Hinglish☆17Aug 31, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Public repository for files related to Dave Langer's "Data Cleaning With Excel" YouTube tutorial series.☆13Jul 26, 2021Updated 5 years ago
- Build Flutter Apps with PostgreSQL, MySQL, or any database, stream data changes through websockets effortlessly, and handle websocket aut…☆14Mar 11, 2025Updated last year
- Collection of programs for financial mathematics and statistics☆11Jan 20, 2020Updated 6 years ago
- ☆19Sep 22, 2026Updated last month
- Contains documentation & code related to the project done by my team for the Object Oriented Analysis and Design laboratory course of my …☆30May 7, 2021Updated 5 years ago
- This project leverages Hadoop, Spark, SQL, and Hive for efficient data integration, transformation, warehousing, and analytics. It provid…☆24Sep 30, 2023Updated 3 years ago
- Introduction to Machine Learning with Time Series workshop☆14Nov 3, 2023Updated 3 years ago
- A learning tool to demonstrate the process of financial forecasting, budgeting, and analysis.☆18Jan 9, 2025Updated last year
- ☆13Aug 1, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Otázky státních závěrečných zkoušek pro studijní program Otevřená informatika ČVUT FEL☆37May 31, 2018Updated 8 years ago
- 參加 2023 ITHome 鐵人賽 DevOps 組佳作【Observability 101】☆32Apr 3, 2024Updated 2 years ago
- ☆17Dec 9, 2023Updated 2 years ago
- Travigui is a job-connecting app that helps workers from any domain find jobs and connects them with people who need a job done. The app …☆19Mar 18, 2023Updated 3 years ago
- This Repository has complete course of python 3 Programming by university of Michigan.☆20Jul 2, 2020Updated 6 years ago
- A Demo project for Apache Kafka on Flask☆28Jun 1, 2022Updated 4 years ago
- java接口自动化测试框架：java + testng + httpclient + allure + fastjson + jsonpath + poi/yaml + log4j☆41Jan 14, 2024Updated 2 years ago
- Flutter 3.0/Node Chat with bcrypt, validators, mongoose jwt and sockets☆15Dec 13, 2022Updated 3 years ago
- This comprehensive collection of notebooks serves as a valuable resource for learners pursuing the IBM AI Engineering Professional Certi…☆15Dec 31, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Sep 30, 2021Updated 5 years ago
- Flutterzon is a full-stack e-commerce application that tries to mirror the functionality and user experience of the Amazon mobile app. Bu…☆18Dec 12, 2023Updated 2 years ago
- MEW (Men's Ethnic Wear) is an ecommerce web application using MERN stack.☆31Dec 12, 2022Updated 3 years ago
- Python tutorial on machine learning with time series for DSSGx 2020☆22Jul 31, 2020Updated 6 years ago
- Source code for the Apache Kafka in Python video series☆20Feb 8, 2022Updated 4 years ago
- ☆32Feb 4, 2025Updated last year
- Derma is an AI skin health assistant which helps to identify your possible skin condition with just few clicks, before things get worse.☆25Apr 19, 2024Updated 2 years ago