okzapradhana / etl-flatfile-airflowView external linksLinks
Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator
☆13May 23, 2021Updated 4 years ago
Alternatives and similar repositories for etl-flatfile-airflow
Users that are interested in etl-flatfile-airflow are comparing it to the libraries listed below
Sorting:
- Demonstrating the concept of Google PubSub, a messaging queue service in Google, thru streaming fake financial data thru PubSub and query…☆15Aug 29, 2017Updated 8 years ago
- End-to-end ELT data engineering project☆22Dec 24, 2022Updated 3 years ago
- DS525☆18Mar 23, 2024Updated last year
- Cardano mainchain data on BigQuery☆11Aug 3, 2023Updated 2 years ago
- ☆12Dec 15, 2023Updated 2 years ago
- Uses Twarc 2 to access Twitter's archive via the API 2.0. Collects, processes and pushes Tweets to a specified Google BigQuery dataset. R…☆12Apr 5, 2023Updated 2 years ago
- Create tables in Google BigQuery, auto-generate their schemas, and retrieve said schemas.☆10Feb 5, 2026Updated last week
- Business and performance KPIs drawn from game analytics using a large dataset☆11Mar 2, 2019Updated 6 years ago
- ☆11Sep 14, 2025Updated 5 months ago
- Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quali…☆13Jul 21, 2021Updated 4 years ago
- ☆11Apr 9, 2022Updated 3 years ago
- Survey app built with ASP.NET Core MVC☆11Aug 18, 2020Updated 5 years ago
- The moderate bots for re-crawling from social medias.☆10Apr 11, 2020Updated 5 years ago
- Alternative BigQuery for using multiple datasets☆12Mar 9, 2021Updated 4 years ago
- Matlab toolbox for generating block structured hex meshes in the polyMesh file format of OpenFOAM.☆13Jan 2, 2013Updated 13 years ago
- Simple solution to make reporting on CWVs from BQ simpler to set up.☆11Feb 5, 2026Updated last week
- Some functions to plot OpenFOAM data with Matplotlib☆11Apr 15, 2021Updated 4 years ago
- ☆13Jul 25, 2024Updated last year
- A CLI tool to perform migrations on BigQuery tables☆11Feb 12, 2022Updated 4 years ago
- Unlocking the Power of SAM 2 for Few-Shot Segmentation (ICML 2025)☆28May 21, 2025Updated 8 months ago
- Example Scala/SBT event producer for Amazon Kinesis☆21Mar 29, 2015Updated 10 years ago
- Official JavaScript client for SlicingDice, Data Warehouse and Analytics Database as a Service.☆11Dec 15, 2018Updated 7 years ago
- Google Cloud Functions examples for Google Cloud Dataprep☆11Feb 12, 2021Updated 5 years ago
- Automatically load data from Google Cloud Storage files into Big Query tables☆11Dec 30, 2022Updated 3 years ago
- Python utilities for BigQuery analyses.☆15Dec 10, 2020Updated 5 years ago
- Create graphed invoice for Google Cloud Platform. You can see billing amount per GCP project.☆11Feb 28, 2022Updated 3 years ago
- ☆13Aug 12, 2019Updated 6 years ago
- Hackerrank, Coursera, other studies☆13Aug 19, 2021Updated 4 years ago
- A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets…☆14Feb 7, 2026Updated last week
- BigQuery Data Connector for Dremio☆12Sep 29, 2023Updated 2 years ago
- ☆10Updated this week
- Bigquery user-defined functions (UDFs) for pathfinding. Find shortest path through a network of Bigquery geography☆11Jan 18, 2021Updated 5 years ago
- Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow☆13Jan 4, 2022Updated 4 years ago
- Hand Gesture Recognition-opencv☆12Jul 10, 2016Updated 9 years ago
- This is the repo for Bruin's Visual Studio Code extension.☆17Updated this week
- Demo code for real-time logging processing on GCP☆15May 1, 2024Updated last year
- Stream your CSV files to an HTTP API☆12Apr 9, 2018Updated 7 years ago
- This repository will contain the code for Java backend developer bootcamp☆11Feb 6, 2025Updated last year
- Export data from Redshift to BigQuery☆12Mar 16, 2018Updated 7 years ago