This project implements a real-time data pipeline using Apache Kafka, Python's psutil library for metric collection, and SQL Server for data storage. The pipeline collects metrics data from the local computer, processes it through Kafka brokers, and loads it into a SQL Server database. Additionally, a real-time dashboard is created using Power B…
☆15Oct 31, 2023Updated 2 years ago
Alternatives and similar repositories for Real-Time-Data-Pipeline-Using-Kafka
Users that are interested in Real-Time-Data-Pipeline-Using-Kafka are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. T…☆27Apr 15, 2024Updated 2 years ago
- The project aims to automate the extraction of data from a YouTube channel, transform the data into a suitable format, and make it availa…☆12Sep 24, 2023Updated 2 years ago
- Compiler design project for UE19CS351 @ PES University - documentation and project outline☆11May 3, 2022Updated 4 years ago
- My personal knowledge-base.☆17Jul 19, 2026Updated last week
- This project demonstrates real-time data streaming and processing architecture using Kafka, Spark Streaming, and Debezium for capturing C…☆16Oct 24, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is the dashboard to see the system information. The code will use Python 3.11, Flask and psutil module to create this dashboard.☆12Nov 15, 2022Updated 3 years ago
- IPM-LSTM: A Learning-Based Interior Point Method for Solving Nonlinear Programs☆14Oct 23, 2025Updated 9 months ago
- A rich and diverse dataset created with GPT-4 for training and evaluating conversational models in Hinglish☆16Aug 31, 2023Updated 2 years ago
- A repository for Mini Project of Compiler Design, 6th Sem, Computer Science, PES University.☆13May 21, 2020Updated 6 years ago
- Homeworks and codes for CTU OI☆12Dec 15, 2023Updated 2 years ago
- Build Flutter Apps with PostgreSQL, MySQL, or any database, stream data changes through websockets effortlessly, and handle websocket aut…☆13Mar 11, 2025Updated last year
- ☆18Sep 22, 2025Updated 10 months ago
- Contains documentation & code related to the project done by my team for the Object Oriented Analysis and Design laboratory course of my …☆29May 7, 2021Updated 5 years ago
- This project leverages Hadoop, Spark, SQL, and Hive for efficient data integration, transformation, warehousing, and analytics. It provid…☆24Sep 30, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Aug 1, 2023Updated 2 years ago
- Otázky státních závěrečných zkoušek pro studijní program Otevřená informatika ČVUT FEL☆37May 31, 2018Updated 8 years ago
- 參加 2023 ITHome 鐵人賽 DevOps 組佳作【Observability 101】☆31Apr 3, 2024Updated 2 years ago
- A Demo project for Apache Kafka on Flask☆28Jun 1, 2022Updated 4 years ago
- Travigui is a job-connecting app that helps workers from any domain find jobs and connects them with people who need a job done. The app …☆19Mar 18, 2023Updated 3 years ago
- MEW (Men's Ethnic Wear) is an ecommerce web application using MERN stack.☆31Dec 12, 2022Updated 3 years ago
- Flutter 3.0/Node Chat with bcrypt, validators, mongoose jwt and sockets☆15Dec 13, 2022Updated 3 years ago
- Flutterzon is a full-stack e-commerce application that tries to mirror the functionality and user experience of the Amazon mobile app. Bu…☆19Dec 12, 2023Updated 2 years ago
- ☆32Feb 4, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A GUI based face recognizer coded in Python☆12Dec 19, 2019Updated 6 years ago
- Derma is an AI skin health assistant which helps to identify your possible skin condition with just few clicks, before things get worse.☆25Apr 19, 2024Updated 2 years ago
- Aspect-based opinion mining on Yelp reviews☆69May 23, 2017Updated 9 years ago
- lots of fun not working to get supporting infrastructure☆11May 25, 2019Updated 7 years ago
- A simple app to demonstrate riverpod using Rick and Morty API(https://rickandmortyapi.com/)☆34Aug 12, 2022Updated 3 years ago
- Microservices Development Cookbook, published by Packt☆11Jan 30, 2023Updated 3 years ago
- List of startups companies in Bangalore - projectstartups.com☆47Jul 12, 2019Updated 7 years ago
- ☆13Dec 21, 2012Updated 13 years ago
- A mobile application with Flutter - Nodejs & MongoDB.☆30Apr 12, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Sep 5, 2023Updated 2 years ago
- Official repo for Recursion's accepted spotlight paper at NeurIPS 2023 Generative AI & Biology workshop.☆78Jun 6, 2025Updated last year
- Projects made in C and C++.☆12May 29, 2021Updated 5 years ago
- A repo of Java examples using Apache Flink with flink-connector-kafka☆10Mar 10, 2026Updated 4 months ago
- Fake Product Identification using Blockchain☆68Jun 12, 2023Updated 3 years ago
- This is a simple ETL project with Python :)☆42Oct 31, 2022Updated 3 years ago
- ☆12Nov 21, 2017Updated 8 years ago