im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-WarehouseView on GitHub
This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeatherAPI and loading it into a data warehouse, specifically AWS Redshift.
☆22Feb 3, 2026Updated last month
Alternatives and similar repositories for Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
Users that are interested in Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse are comparing it to the libraries listed below
Sorting:
- Super Mario is a legendary game we all cherish! In this project, we will deploy Super Mario on Amazon EKS (Elastic Kubernetes Service) us…☆11Feb 3, 2026Updated last month
- capstone project for Dataengineer.io bootcamp Public Repo☆12Feb 20, 2024Updated 2 years ago
- In this web scraping project, my goal is to extract real-time stock market data from the renowned Yahoo Finance website. By leveraging we…☆13Jun 12, 2023Updated 2 years ago
- ☆16May 29, 2023Updated 2 years ago
- 𝘼 𝙧𝙚𝙥𝙤𝙨𝙞𝙩𝙤𝙧𝙮 𝙙𝙚𝙙𝙞𝙘𝙖𝙩𝙚𝙙 𝙩𝙤 𝙚𝙭𝙥𝙡𝙤𝙧𝙞𝙣𝙜 𝙖𝙣𝙙 𝙞𝙢𝙥𝙡𝙚𝙢𝙚𝙣𝙩𝙞𝙣𝙜 𝙋𝙧𝙤𝙢𝙚𝙩𝙝𝙚𝙪𝙨 𝙛𝙤𝙧 𝙢𝙤𝙣𝙞𝙩…☆20Mar 15, 2025Updated 11 months ago
- AWS DevOps Real-Time Deployment - Dev → Pre-PROD → Production☆27Feb 14, 2026Updated 3 weeks ago
- A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.☆14Dec 15, 2024Updated last year
- ☆13Mar 27, 2018Updated 7 years ago
- This is a comprehensive end-to-end data engineering project. I extracted data directly from YouTube in raw JSON format using Python and A…☆11Jun 4, 2024Updated last year
- ☆15Sep 14, 2023Updated 2 years ago
- Study and research with your docs, media, and AI in one place☆34Updated this week
- Playable synthesizer created with Tone.js, Next.js, and React.☆10Aug 14, 2022Updated 3 years ago
- Multiprocessing in python☆10Aug 20, 2021Updated 4 years ago
- ☆16May 26, 2025Updated 9 months ago
- This is the official repository for the paper "Words That Unite The World: A Unified Framework for Deciphering Global Central Bank Commun…☆17Oct 19, 2025Updated 4 months ago
- a tui ssh app framework for rust☆16Feb 27, 2026Updated last week
- This web extension allows users to navigate Glassdoor while logged out.☆13Jan 15, 2025Updated last year
- Free tool to copy CSVs from https://chartink.com/☆15Sep 7, 2025Updated 6 months ago
- Simple terminal UI for managing /etc/hosts files!☆17Aug 18, 2024Updated last year
- A simple javascript library for reading glucose data from the Dexcom Share API.☆10Aug 11, 2023Updated 2 years ago
- Program summarizes news articles into a couple of sentences. This project was inspired by SMMRY, the algorithm used in many subreddits to…☆10Jan 15, 2019Updated 7 years ago
- This repository is a full-stack food delivery application inspired by Zomato. It includes a React.js frontend and integrates DevSecOps pr…☆14Apr 4, 2025Updated 11 months ago
- OpenExchange web application☆16Apr 5, 2025Updated 11 months ago
- My solutions for the Udacity Data Engineering Nanodegree☆34Oct 14, 2019Updated 6 years ago
- ☆10Aug 12, 2024Updated last year
- ☆11Apr 8, 2024Updated last year
- Zero-Config Terraform Module to deploy Next.js Apps on AWS using Serverless resources☆12Dec 4, 2025Updated 3 months ago
- Tools for diffing and comparing web content. Also includes a web server that makes diffs available as an HTTP service.☆18Mar 1, 2026Updated last week
- Google Cloud Platform (GCP) CLI and utils☆14May 6, 2023Updated 2 years ago
- // A beginner-friendly guide to setting up AWS infrastructure using Terraform! Learn how to automate and manage cloud resources with eas…☆14Jan 25, 2026Updated last month
- Feature Packed Self-Hosted File Sharing☆11Aug 14, 2025Updated 6 months ago
- Integrating with Spotify API and extracting Data. Deploying code on AWS Lambda for Data Extraction. Adding trigger to run the extraction …☆11Jul 5, 2023Updated 2 years ago
- A simple example to showcase machine learning model deployment with an API☆10Mar 7, 2022Updated 4 years ago
- GraphQL API for cloud pricing. Contains over 3M public prices from AWS, Azure and GCP. Self-updates prices via an automated weekly job.☆19Updated this week
- Prometheus exporter for Amazon Smart Air Quality Monitor☆12Jan 21, 2022Updated 4 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆11May 25, 2023Updated 2 years ago
- LangSmithGo is a Golang-based client library designed to interface with the LangSmith API for tracking and monitoring large language mode…☆16Feb 13, 2025Updated last year
- How To Convert Python File To Executable File (.py to. exe) | Python Tutorial☆13Feb 26, 2023Updated 3 years ago
- ☆14Feb 17, 2025Updated last year