NitinDatta8 / realtime-data-streamingLinks
End-to-end data engineering pipeline with various technologies to ingest real time data.
☆16Updated last year
Alternatives and similar repositories for realtime-data-streaming
Users that are interested in realtime-data-streaming are comparing it to the libraries listed below
Sorting:
- An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…☆273Updated 6 months ago
- Nyc_Taxi_Data_Pipeline - DE Project☆120Updated 10 months ago
- Hands-on MLOps projects to explore and learn the practical aspects of machine learning engineering for production.☆73Updated 5 months ago
- Machine Learning In Production (MLOps)☆157Updated last week
- Learn PySpark from Basics to Advanced. Checkout the YouTube Series : [PySpark - Zero to Hero]☆80Updated 7 months ago
- ☆84Updated 7 months ago
- ☆287Updated last year
- End-to-end Data Project (DA/DS/DE/MLOps) - retail/e-commerce - interpretable dynamic clustering☆14Updated last month
- Architected a SQL-based Superstore Data Warehouse to analyse trends of customer records to identify profitable market segments and design…☆11Updated 11 months ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆102Updated 5 months ago
- Cool DE Projects☆34Updated 2 weeks ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆153Updated last year
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆358Updated last year
- This project introduces PySpark, a powerful open-source framework for distributed data processing. We explore its architecture, component…☆34Updated 11 months ago
- A turnkey MLOps pipeline demonstrating how to go from raw events to real-time predictions at scale.☆214Updated 7 months ago
- Free Data Engineering YouTube BootCamp by Zach Wilson from DataExpert.io☆14Updated 5 months ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆21Updated 2 years ago
- This repo contains all the code used in the Python for Data Engineering Course☆306Updated last year
- Natural Language Processing (NLP) mini projects and implementations.☆29Updated 4 years ago
- Production ML rental prediction system.☆48Updated last year
- This repository is to show my Data Analytics & Engineering skills, share projects, and track my progress.☆56Updated 2 years ago
- ☆21Updated 11 months ago
- More than 2000+ Data engineer interview questions.☆1,403Updated 7 months ago
- My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggrega…☆504Updated 3 years ago
- This repo demonstrates the development of a real-time data pipeline designed to ingest, process, and analyze stock market data. Using cut…☆43Updated last year
- ☆104Updated 2 years ago
- ☆203Updated 2 years ago
- ☆27Updated 6 months ago
- ☆68Updated last year
- ☆1,375Updated 3 years ago