YemiOla / data_engineering_project_openweathermap_api_airflow_etl_awsLinks
☆21Updated 2 years ago
Alternatives and similar repositories for data_engineering_project_openweathermap_api_airflow_etl_aws
Users that are interested in data_engineering_project_openweathermap_api_airflow_etl_aws are comparing it to the libraries listed below
Sorting:
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29Updated 2 years ago
- ☆204Updated 2 years ago
- YouTube tutorial project☆105Updated last year
- ☆29Updated last year
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆12Updated 2 years ago
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆22Updated 2 years ago
- # **ABSTRACT** Main Objective: The main agenda of this project is: Perform extensive Exploratory Data Analys…☆34Updated 4 years ago
- Business challenge that requires building a data platform for retailer data analytics.☆15Updated 2 years ago
- ☆68Updated last month
- ☆39Updated 11 months ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆156Updated last year
- ☆102Updated 2 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated 2 years ago
- IBM Data Engineering Courses from Coursera☆71Updated 2 years ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆206Updated last year
- ☆21Updated 2 years ago
- For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retri…☆26Updated 4 years ago
- Python ETL demo for Hackforge☆32Updated last year
- The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …☆121Updated 3 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆24Updated 2 years ago
- Credit Card Fraud Detection App built with Streamlit, FastAPI and Docker.☆51Updated 3 years ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆41Updated last year
- ☆167Updated 2 years ago
- ☆142Updated 2 years ago
- ☆21Updated last year
- ☆88Updated 3 years ago
- Simple ETL pipeline using Python☆27Updated 2 years ago
- Cracking Data Engineering Interview Guide, published by Packt☆44Updated last year
- Found a data engineering challenge or participated in a selection process ? Share with us!☆65Updated 2 years ago
- SQL for Data Analysis using PostgresSQL - analyzing Parch&Posey fictional company☆18Updated 5 years ago