im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-WarehouseView on GitHub
This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeatherAPI and loading it into a data warehouse, specifically AWS Redshift.
☆22Feb 3, 2026Updated 6 months ago
Alternatives and similar repositories for Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
Users that are interested in Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- In this web scraping project, my goal is to extract real-time stock market data from the renowned Yahoo Finance website. By leveraging we…☆13Jun 12, 2023Updated 3 years ago
- ☆16May 29, 2023Updated 3 years ago
- ☆19May 27, 2023Updated 3 years ago
- Data Engineering & Analysis Project- San Francisco Eviction Data ETL Pipeline An end-to-end batch data pipeline for performing ETL on San…☆10Oct 2, 2025Updated 10 months ago
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This checklist aims to be an exhaustive list of all elements you should consider when using Amazon Redshift.☆15Sep 21, 2020Updated 5 years ago
- Udacity Data Engineer Nanodegree - Capstone project☆11Dec 19, 2019Updated 6 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆13May 25, 2023Updated 3 years ago
- A scalable FastAPI project template with async SQLAlchemy, PostgreSQL, and repository pattern implementation. Features JWT authentication…☆16Aug 15, 2025Updated 11 months ago
- ☆18Feb 1, 2025Updated last year
- Proof of Concept Chatbot☆10Jan 13, 2023Updated 3 years ago
- A modern Login UI made with Flutter. It has Welcome Page, Login Page and Sign Up page.☆14Aug 9, 2021Updated 5 years ago
- ☆12Jan 2, 2024Updated 2 years ago
- Repository for the D ONE MLOps AWS BlogPost☆10May 5, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Prediction of travel time has major concern in the research domain of Intel- ligent Transportation Systems (ITS). Clustering strategy can…☆11May 31, 2018Updated 8 years ago
- Submission for the STEM Virtual Program by Deloitte via Forage.☆15Oct 5, 2023Updated 2 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- Aspect based sentiment analysis aims to detect an aspect (i.e. features) in a given text and then perform sentiment analysis of the text …☆11Nov 15, 2021Updated 4 years ago
- A real-time financial data streaming pipeline and visualization platform using Apache Kafka, Cassandra, and Bokeh.☆16Oct 27, 2022Updated 3 years ago
- An end-to-end workflow for processing streaming data on Azure.☆17Sep 20, 2024Updated last year
- origin S_transform matlab code transfered to Python☆20Mar 22, 2019Updated 7 years ago
- Steve's coffee shop recipe project for the Pluralsight Course "Git Fundamentals"☆21Mar 13, 2023Updated 3 years ago
- Material for tutorial "Hybrid techniques for knowledge-based NLP: Knowledge graphs meet machine learning and all their friends" at KCAP…☆16Dec 4, 2017Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An open source, API centric chat bot platform in Django Rest framework developed with python chatterbot and NLTK packages.☆11Jan 28, 2024Updated 2 years ago
- ☆14Mar 27, 2018Updated 8 years ago
- Implement a ChatGPT-like LLM in PyTorch from scratch, step by step☆24Apr 13, 2025Updated last year
- Python wrapper for the Open Brewery DB API☆16Mar 7, 2024Updated 2 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆25May 14, 2022Updated 4 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- My DDD(Domain Driven Design) template for quickly bootstrapping Flutter apps inspired by Resocoder☆23Apr 9, 2024Updated 2 years ago
- A template for dockerized dbt-Core projects with VS Code Dev Containers.☆21Nov 14, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A micro cluster lab to experiment Dask and Spark (Python and Scala) based on Docker☆16Mar 7, 2023Updated 3 years ago
- This is a comprehensive end-to-end data engineering project. I extracted data directly from YouTube in raw JSON format using Python and A…☆12Jun 4, 2024Updated 2 years ago
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 3 years ago
- ☆14Mar 9, 2023Updated 3 years ago
- Combining advanced ultrasonic sensors with an intuitive Android app, it offers real-time obstacle detection and navigation guidance, enha…☆11Aug 21, 2023Updated 2 years ago
- Rock Solid Python with Type Hints Course Student Materials☆25Jul 8, 2024Updated 2 years ago
- Code for "Efficient Data Processing in Spark" Course☆392Jun 29, 2026Updated last month