This is a simple ETL using Airflow. First, we fetch data from API (extract). Then, we drop unused columns, convert to CSV, and validate (transform). Finally, we load the transformed data to database (load).
☆24Oct 12, 2019Updated 6 years ago
Alternatives and similar repositories for airflow-etl-learn
Users that are interested in airflow-etl-learn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Enhanced Fetch API with first class support for JSON objects☆17May 27, 2022Updated 4 years ago
- ☆15Jan 22, 2017Updated 9 years ago
- A data pipeline moving data from a Relational database system (RDBMS) to a Hadoop file system (HDFS).☆15Jun 3, 2021Updated 5 years ago
- Super simple API for first name to gender conversion.☆12Nov 22, 2017Updated 8 years ago
- Create first API at Reprograma.☆12Dec 11, 2022Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Mar 3, 2025Updated last year
- Matching messy Pandas columns with FuzzyWuzzy (Medium Article)☆13Sep 29, 2019Updated 6 years ago
- Developed a multi-user to-do list management web application that gives users the ability to create multiple checklists of tasks, and mar…☆12May 15, 2017Updated 9 years ago
- Udacity data engineering nanodegree project☆22Nov 8, 2019Updated 6 years ago
- ☆17Nov 20, 2020Updated 5 years ago
- Laravel API Boilerplate is a ready-to-use "starting pack" that you can use to build your first API in seconds. As you can easily imagine,…☆10Feb 25, 2017Updated 9 years ago
- Your Top Spotify Listening Habits, Favorite Artists, and Song Recommendations in a Playlist🎧🎶☆19May 9, 2026Updated last month
- A simple example of how to create a RESTful API in Laravel Framework 8.36.1.☆12Jun 11, 2026Updated last week
- An open source, privacy-first, self-hosting capable and blazing fast search engine written in JavaScript. Browse anonymously and safely …☆11Sep 10, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Data transformation☆23Apr 18, 2021Updated 5 years ago
- Pakistan First Stock Exchange Comprehensive Api☆10Oct 8, 2023Updated 2 years ago
- A pure MCP (Model Context Protocol) server for TikTok Business API integration, designed for AI-first interactions.☆34Apr 20, 2026Updated last month
- An Airflow pipeline for the collection of historical Twitter data☆10Aug 5, 2019Updated 6 years ago
- import os lib = input(""" [1] Download lib & update [2] pass [+] Please Choice >> """) if lib == "1": os.system('pip install reques…☆15Jul 19, 2021Updated 4 years ago
- Schedule a data pipeline in Google Cloud using cloud function, BigQuery, cloud storage, cloud scheduler, stack trace, cloud build, and p…☆25Jun 4, 2019Updated 7 years ago
- AlvinToh Learning Repository for The Ultimate Hands-On Hadoop - Tame your Big Data!☆10May 23, 2018Updated 8 years ago
- A dashboard is worth a thousand words => https://datastudio.google.com/reporting/755f3183-dd44-4073-804e-9f7d3d993315☆28Oct 30, 2021Updated 4 years ago
- Use fastAPI to generate html web app that will serve a local directory or S3 bucket of images☆11Jan 18, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- First Street API Access (Python)☆13Nov 23, 2021Updated 4 years ago
- C memory allocator with selectable First/Next/Best-Fit, per-allocation tracing, optional mark-and-sweep GC, and a configurable logging AP…☆16May 8, 2026Updated last month
- A privacy-first contact tracing solution for Android and iOS where users have full control over their data without the Google or Apple Co…☆14Jul 20, 2020Updated 5 years ago
- ☆27Mar 7, 2022Updated 4 years ago
- 🍑 Doctor 🥭 Backend an 🍏 amazing 🥬 production 🌰 ready 🍿 backend 🏡 system 🕍 designed 🚋 managing 🚂 medical professionals ✈ appoint…☆40Jul 28, 2025Updated 10 months ago
- Welcome to WarrenGPT a trading AI & the worlds first opensource AI ML trading AI bot the white paper coming soon goal of WarrenGPT is to…☆13May 2, 2023Updated 3 years ago
- Active Statistics book web page☆12Jan 3, 2025Updated last year
- Project to collect #codenewbie tweets, display them in a webapp, create a new api endpoint, and inspire more first-time open source contr…☆11Feb 2, 2023Updated 3 years ago
- ☆12Aug 22, 2018Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Laravel API Boilerplate is a ready-to-use "starting pack" that you can use to build your first API in seconds. As you can easily imagine,…☆11Feb 25, 2017Updated 9 years ago
- Implementation and In-depth Explanations of Algorithmic-based questions and data structures.☆20Jan 18, 2022Updated 4 years ago
- B+ tree implementation in C++ for NTU's CZ4031 course of Database Systems Principles. Supports duplicate keys.☆11Oct 24, 2020Updated 5 years ago
- Spark data pipeline that processes movie ratings data.☆31May 1, 2026Updated last month
- ADD SUPPORT FOR YOUR COIN The development and services behind Noble were crowdfunded via the sale of the NOXT token. This token can be u…☆18Mar 27, 2017Updated 9 years ago
- A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…☆29Aug 8, 2020Updated 5 years ago
- A simple Python Twitter Reply Bot which was made using Tweepy☆17Dec 12, 2022Updated 3 years ago