yesdinesh / Object-Detection-using-Spark-Docker-Kafka-Video-Streaming
☆11Updated 3 years ago
Related projects: ⓘ
- Predicting the Remaining Useful Life (RUL) of simulated Turbofan Engines using Spark ML, Spark Structured Streaming, and Kafka.☆20Updated last year
- Project for real-time anomaly detection using Kafka and python☆55Updated last year
- ☆35Updated 2 months ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆56Updated last year
- Testing Spark Structured Streaming anf Kafka with real data from traffic sensors☆15Updated last year
- Mobile robot data were analyzed with Apache-Spark to extract five different statistical result such as travel time, waiting time, average…☆12Updated 2 years ago
- Sample MLOps Workflow: Recognizing Digits with Kubeflow☆139Updated 6 months ago
- Simple ETL pipeline using Python☆20Updated last year
- Design/Implement stream/batch architecture on NYC taxi data | #DE☆26Updated 3 years ago
- ☆14Updated 4 years ago
- End-to-end Kafka Streaming Examples on Databricks with Evolving Avro Schemas.☆9Updated 6 months ago
- ☆36Updated 4 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆19Updated 2 years ago
- Spark, Airflow, Kafka☆27Updated last year
- ☆30Updated last year
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆33Updated last year
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆20Updated last year
- Nyc_Taxi_Data_Pipeline - DE Project☆62Updated last month
- This workshop will familiarize you with some of the key steps towards building an end-to-end predictive maintenance system leveraging Ama…☆28Updated 4 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆36Updated 11 months ago
- The goal of this project is to build a docker cluster that gives access to Hadoop, HDFS, Hive, PySpark, Sqoop, Airflow, Kafka, Flume, Pos…☆48Updated last year
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆24Updated 9 months ago
- The end-to-end computer vision (object detection) project with MLOps, including a model training pipeline/workflow, an API, and an applic…☆20Updated last year
- An open-source project dedicated to constructing robust data pipelines and scalable software infrastructure. We leverage industry-standar…☆33Updated 3 months ago
- Building a machine learning model to predict energy consumption using LSTM (Long-Short Term Memory)☆29Updated last year
- The workshop is designed to foster an enabling environment for individuals to build competence in the Edge Computing space.☆14Updated last year
- PySpark Tutorial for Beginners on Google Colab: Hands-On Guide☆16Updated 4 years ago
- Demo Computer Vision Project☆59Updated last year
- ☆59Updated this week
- This repo gives an introduction to setting up streaming analytics using open source technologies☆21Updated last year