This is a simple ETL using Airflow. First, we fetch data from API (extract). Then, we drop unused columns, convert to CSV, and validate (transform). Finally, we load the transformed data to database (load).
☆24Oct 12, 2019Updated 6 years ago
Alternatives and similar repositories for airflow-etl-learn
Users that are interested in airflow-etl-learn are comparing it to the libraries listed below
Sorting:
- A rapid development full stack webapp template; FastAPI, SQLModel, Angular, Ionic, Firebase, GCP, Auth0☆12Aug 25, 2025Updated 6 months ago
- ☆10Dec 2, 2024Updated last year
- The constitution for a decentralized autonomous organization for accelerating clinical research through open-source software collaboratio…☆11Apr 21, 2022Updated 3 years ago
- ☆10Oct 20, 2022Updated 3 years ago
- A command-line interface for interacting with the NeoLoad Web Platform...running tests, reporting results, etc...on your workstation or i…☆10Jan 20, 2026Updated last month
- Visual DDD 客户端☆13Jul 2, 2024Updated last year
- Connect your Jenkins server to Jira Software Cloud for more visibility into your development pipeline☆12Updated this week
- SAPProx is a proof of concept tool for intercepting and modifying SAP GUI (DIAG protocol) traffic.☆13Apr 20, 2017Updated 8 years ago
- FastAPI Template☆11Jan 11, 2025Updated last year
- A command line tool to enable/disable your pihole☆13Mar 25, 2025Updated 11 months ago
- give me a toml configuration file, I'll give you export MY_ENV=foo☆10Jul 6, 2018Updated 7 years ago
- TestLink Data Container☆10Feb 1, 2019Updated 7 years ago
- Sonic 2 MSU-MD romhack for having CD quality audio in the game on real hardware and emulators.☆14Jan 23, 2021Updated 5 years ago
- ABAP CI using Postman☆13Jan 10, 2019Updated 7 years ago
- An Airflow pipeline for the collection of historical Twitter data☆10Aug 5, 2019Updated 6 years ago
- ☆20Nov 19, 2024Updated last year
- Udacity Data Engineering Nano Degree Project, Data Modeling for fact and dimension tables, and ETL pipeline that transfers data from file…☆10Dec 12, 2020Updated 5 years ago
- AlvinToh Learning Repository for The Ultimate Hands-On Hadoop - Tame your Big Data!☆10May 23, 2018Updated 7 years ago
- a Staging location to track my changes from https://bitbucket.org/ixtab/kindlelauncher☆13Feb 14, 2018Updated 8 years ago
- Your Top Spotify Listening Habits, Favorite Artists, and Song Recommendations in a Playlist🎧🎶☆19May 19, 2025Updated 9 months ago
- Sync Strava activities from any Garmin device☆12Apr 8, 2022Updated 3 years ago
- Sample FastAPI + React☆10Feb 16, 2026Updated 3 weeks ago
- Learn Microservices with Spring Boot (2nd edition) - Chapter 8 (FINAL)☆12Dec 2, 2020Updated 5 years ago
- Example project using nginx-unit, fastapi and vue.js, all in one docker image☆11Sep 29, 2023Updated 2 years ago
- Pi-Hole Custom Block Page☆12Jan 2, 2022Updated 4 years ago
- ML FAQ model demo with rasa & Docker☆11Oct 21, 2024Updated last year
- Exporsts data from Ubiquiti Unifi controller to disk or SQL database☆12Dec 1, 2020Updated 5 years ago
- Read SACD ISO files list & extract tracks using sacd_extract☆12Jul 8, 2018Updated 7 years ago
- A helm chart for deploying Neoload Web on your Kubernetes cluster☆13Updated this week
- Hayden Housen's solutions to the 2022 PicoCTF Competition☆10Apr 11, 2022Updated 3 years ago
- A lightweight real-time dashboard for mobility data.☆12Jun 9, 2022Updated 3 years ago
- [DISCONTINUED] Control your Philips Hue Lighting System via Garmin Connect IQ☆12Oct 28, 2019Updated 6 years ago
- ☆11Sep 9, 2019Updated 6 years ago
- A set of utilities and tools to detect and search AI-generated code☆28May 30, 2025Updated 9 months ago
- This notebook includes data scraping. For this beautifulsoup and selinium is used. It takes a website URL as an input and extracts the in…☆10Aug 4, 2021Updated 4 years ago
- REST API with FastAPI, PostgreSQL, Alembic, SQLAlchemy and Minio (S3 cloud storage)☆13Apr 18, 2023Updated 2 years ago
- Vue js Axios example - Get/Post/Put/Delete request with Rest API - JSON data☆15Feb 15, 2022Updated 4 years ago
- FourThree Utility - Dualboot iPad 2 devices to iOS 4.3.x☆14Sep 1, 2025Updated 6 months ago
- This repo contains implementation of various functionalities of various message queues in Python.☆12Aug 13, 2020Updated 5 years ago