This is a simple ETL using Airflow. First, we fetch data from API (extract). Then, we drop unused columns, convert to CSV, and validate (transform). Finally, we load the transformed data to database (load).
☆24Oct 12, 2019Updated 6 years ago
Alternatives and similar repositories for airflow-etl-learn
Users that are interested in airflow-etl-learn are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Udacity Data Engineering Nano Degree Project, Data Modeling for fact and dimension tables, and ETL pipeline that transfers data from file…☆10Dec 12, 2020Updated 5 years ago
- Training two models, one with with AutoML & one with HyperDrive, compare, and deploy the best model as a service - A Machine Learning Eng…☆16Jan 25, 2022Updated 4 years ago
- Local SQL Database ---> Azure ---> Power BI☆15Oct 13, 2023Updated 2 years ago
- Shunting Yard is a real-time data replication tool that copies data between Hive Metastores.☆20Oct 11, 2021Updated 4 years ago
- Enhanced Fetch API with first class support for JSON objects☆17May 27, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- validation-first schema library with a functional api☆18Jul 8, 2026Updated 2 months ago
- Laravel API Boilerplate is a ready-to-use "starting pack" that you can use to build your first API in seconds. As you can easily imagine,…☆10Feb 25, 2017Updated 9 years ago
- Me gusta cuando callas por que estas como ausente☆14Jan 5, 2022Updated 4 years ago
- Data Vault 2.0: Code generation, Vertica, Airflow☆12Nov 20, 2019Updated 6 years ago
- Super simple API for first name to gender conversion.☆12Nov 22, 2017Updated 8 years ago
- Create first API at Reprograma.☆12Dec 11, 2022Updated 3 years ago
- ☆10Oct 20, 2022Updated 3 years ago
- import os lib = input(""" [1] Download lib & update [2] pass [+] Please Choice >> """) if lib == "1": os.system('pip install reques…☆16Jul 19, 2021Updated 5 years ago
- First-ever code-free and lightweight cross platform API and database test automation tool.☆13Jan 22, 2024Updated 2 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆10Mar 3, 2025Updated last year
- Matching messy Pandas columns with FuzzyWuzzy (Medium Article)☆13Sep 29, 2019Updated 6 years ago
- Build APIs and consume them in React apps with complete type safety, optimistic mutations, and offline first functionality.☆13Mar 14, 2025Updated last year
- AlvinToh Learning Repository for The Ultimate Hands-On Hadoop - Tame your Big Data!☆10May 23, 2018Updated 8 years ago
- C memory allocator with selectable First/Next/Best-Fit, per-allocation tracing, optional mark-and-sweep GC, and a configurable logging AP…☆18Updated this week
- This is an Analysis to optimise inventory managemnt for FitCapacity company by analyzing sales and inventory data using SQL and PowerBI☆30Sep 6, 2023Updated 3 years ago
- ⇋ A REST/gRPC server for Instill Model API service☆17May 4, 2026Updated 4 months ago
- Template to deploy Synapse Analytics using best practices to deliver a proof of concept.☆21Mar 3, 2023Updated 3 years ago
- This repo contains implementation of various functionalities of various message queues in Python.☆13Aug 13, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Developed a multi-user to-do list management web application that gives users the ability to create multiple checklists of tasks, and mar…☆12May 15, 2017Updated 9 years ago
- A simple example of how to create a RESTful API in Laravel Framework 8.36.1.☆12Aug 4, 2026Updated last month
- An open source, privacy-first, self-hosting capable and blazing fast search engine written in JavaScript. Browse anonymously and safely …☆12Sep 10, 2024Updated 2 years ago
- Udacity data engineering nanodegree project☆22Nov 8, 2019Updated 6 years ago
- Entity Framework Core is a lightweight, extensible, open-sourced version of the Entity Framework Data Access Technology built for .NET Co…☆10May 22, 2020Updated 6 years ago
- UNIX top-like script for monitoring SASWORK and SASUTIL directories. If you find this useful then check out ESM for SAS® -☆17Feb 28, 2020Updated 6 years ago
- ☆10May 13, 2018Updated 8 years ago
- NodeJS Clean Architecture. Clean Architecture is an opinionated boilerplate for Node web APIs focused on separation of concerns and scal…☆11Jul 1, 2019Updated 7 years ago
- Data transformation☆23Apr 18, 2021Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A microservice-based shopping webapp that uses API-first approach, Spring Boot 3, Kafka 3, Schema Registry, Liquibase, Flyway, gRPC, Grap…☆13Oct 20, 2024Updated last year
- My personal base for React using hooks, typescript, redux, my own api middleware, axios, a personalized webpack config, scss, atomic-desi…☆13Jan 3, 2023Updated 3 years ago
- Laravel API Boilerplate is a ready-to-use "starting pack" that you can use to build your first API in seconds. As you can easily imagine,…☆11Feb 25, 2017Updated 9 years ago
- A privacy-first contact tracing solution for Android and iOS where users have full control over their data without the Google or Apple Co…☆14Jul 20, 2020Updated 6 years ago
- #!/usr/bin/python3 #-*-coding:utf-8-*- # Made With ❤️ By Ahmar And AHMARCODE Project # Update V0.1 # Copyright© Ahmar ID 2021 # 100% Ope…☆17Dec 11, 2021Updated 4 years ago
- ☆27Mar 7, 2022Updated 4 years ago
- A starter repo for Express, using Fern☆16Mar 16, 2026Updated 6 months ago