This project implements a real-time data pipeline using Apache Kafka, Python's psutil library for metric collection, and SQL Server for data storage. The pipeline collects metrics data from the local computer, processes it through Kafka brokers, and loads it into a SQL Server database. Additionally, a real-time dashboard is created using Power B…
☆15Oct 31, 2023Updated 2 years ago
Alternatives and similar repositories for Real-Time-Data-Pipeline-Using-Kafka
Users that are interested in Real-Time-Data-Pipeline-Using-Kafka are comparing it to the libraries listed below
Sorting:
- This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. T…☆23Apr 15, 2024Updated last year
- A GUI based face recognizer coded in Python☆12Dec 19, 2019Updated 6 years ago
- Projects made in C and C++.☆10May 29, 2021Updated 4 years ago
- ☆11Nov 30, 2019Updated 6 years ago
- A repo of Java examples using Apache Flink with flink-connector-kafka☆10Oct 5, 2022Updated 3 years ago
- ☆10Nov 12, 2021Updated 4 years ago
- A frontend application simulating an unix terminal with access to my profissional profile☆12Mar 11, 2021Updated 4 years ago
- lots of fun not working to get supporting infrastructure☆11May 25, 2019Updated 6 years ago
- ☆11Sep 5, 2023Updated 2 years ago
- This project leverages Hadoop, Spark, SQL, and Hive for efficient data integration, transformation, warehousing, and analytics. It provid…☆21Sep 30, 2023Updated 2 years ago
- Microservices Development Cookbook, published by Packt☆11Jan 30, 2023Updated 3 years ago
- The project aims to automate the extraction of data from a YouTube channel, transform the data into a suitable format, and make it availa…☆12Sep 24, 2023Updated 2 years ago
- In this article, we will see how to secure a spring-boot 2 application using keycloak. I will be using the `keycloak-spring-boot-2-adapte…☆10Aug 1, 2024Updated last year
- React ToDo App☆12Mar 5, 2023Updated 3 years ago
- Docker container with SonarQube and useful plugins for Java related projects☆10Sep 20, 2017Updated 8 years ago
- ☆12Mar 26, 2024Updated last year
- Advanced JavaScript for beginners☆13Aug 29, 2017Updated 8 years ago
- IPM-LSTM: A Learning-Based Interior Point Method for Solving Nonlinear Programs☆13Oct 23, 2025Updated 4 months ago
- ☆13Dec 21, 2012Updated 13 years ago
- 台湾大学李宏毅教授《2024 春季生成式 AI 导论》课程笔记与代码仓库，涵盖大型语言模型（LLM）、扩散模型、多模态生成等前沿技术，包含作业实现、论文精读和项目实战。☆21Aug 13, 2025Updated 6 months ago
- This is the dashboard to see the system information. The code will use Python 3.11, Flask and psutil module to create this dashboard.☆11Nov 15, 2022Updated 3 years ago
- Collection of the resources sequentially for learning kubernetes including necessary hands-on.☆12Feb 17, 2021Updated 5 years ago
- A demo Spring Cloud Task that pipes files from S3 to a database☆12Nov 30, 2016Updated 9 years ago
- sample for setup kubernetes cluster ,deploy spring cloud and debug via telepresence☆13Aug 26, 2024Updated last year
- My personal knowledge-base.☆17Dec 27, 2025Updated 2 months ago
- ☆12Nov 21, 2017Updated 8 years ago
- All Solutions for July Leetcoding Challenge!☆12Jul 31, 2020Updated 5 years ago
- Compiler design project for UE19CS351 @ PES University - documentation and project outline☆11May 3, 2022Updated 3 years ago
- the code for the online training conducted July 13, 2018☆16Jul 13, 2018Updated 7 years ago
- Personal notes for the book Building Microservices by Sam Newman☆16Oct 3, 2020Updated 5 years ago
- Make your first Pull Request on Hacktoberfest 2022. Don't forget to spread love and if you like give us a ⭐️. If you want to contribute t…☆13Oct 31, 2022Updated 3 years ago
- A rich and diverse dataset created with GPT-4 for training and evaluating conversational models in Hinglish☆15Aug 31, 2023Updated 2 years ago
- ☆11Jun 1, 2023Updated 2 years ago
- ☆13Aug 1, 2023Updated 2 years ago
- ☆11Apr 26, 2017Updated 8 years ago
- Code samples from my blog, https://poanchen.github.io/blog/☆12Oct 28, 2020Updated 5 years ago
- My solutions for Advent of Code 2018☆16Dec 5, 2021Updated 4 years ago
- Build Flutter Apps with PostgreSQL, MySQL, or any database, stream data changes through websockets effortlessly, and handle websocket aut…☆13Mar 11, 2025Updated 11 months ago
- Javalab - the open-source web laboratory for JVM languages☆13Oct 14, 2016Updated 9 years ago