Building Data Warehouse on BigQuery which takes flat file as the data sources with Airflow as the Orchestrator
☆12May 23, 2021Updated 4 years ago
Alternatives and similar repositories for etl-flatfile-airflow
Users that are interested in etl-flatfile-airflow are comparing it to the libraries listed below
Sorting:
- Demonstrating the concept of Google PubSub, a messaging queue service in Google, thru streaming fake financial data thru PubSub and query…☆15Aug 29, 2017Updated 8 years ago
- End-to-end ELT data engineering project☆22Dec 24, 2022Updated 3 years ago
- DS525☆18Mar 23, 2024Updated last year
- Cardano mainchain data on BigQuery☆11Aug 3, 2023Updated 2 years ago
- Uses Twarc 2 to access Twitter's archive via the API 2.0. Collects, processes and pushes Tweets to a specified Google BigQuery dataset. R…☆12Apr 5, 2023Updated 2 years ago
- ☆12Dec 15, 2023Updated 2 years ago
- Business and performance KPIs drawn from game analytics using a large dataset☆11Mar 2, 2019Updated 7 years ago
- Create tables in Google BigQuery, auto-generate their schemas, and retrieve said schemas.☆10Feb 25, 2026Updated last week
- ☆11Sep 14, 2025Updated 5 months ago
- Google Cloud Functions examples for Google Cloud Dataprep☆11Feb 12, 2021Updated 5 years ago
- Create graphed invoice for Google Cloud Platform. You can see billing amount per GCP project.☆11Feb 28, 2022Updated 4 years ago
- Official JavaScript client for SlicingDice, Data Warehouse and Analytics Database as a Service.☆11Dec 15, 2018Updated 7 years ago
- Example Scala/SBT event producer for Amazon Kinesis☆21Mar 29, 2015Updated 10 years ago
- Python utilities for BigQuery analyses.☆15Dec 10, 2020Updated 5 years ago
- Survey app built with ASP.NET Core MVC☆11Aug 18, 2020Updated 5 years ago
- Hackerrank, Coursera, other studies☆13Aug 19, 2021Updated 4 years ago
- A CLI tool to perform migrations on BigQuery tables☆11Feb 12, 2022Updated 4 years ago
- ☆13Jul 25, 2024Updated last year
- The moderate bots for re-crawling from social medias.☆10Apr 11, 2020Updated 5 years ago
- Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quali…☆13Jul 21, 2021Updated 4 years ago
- Matlab toolbox for generating block structured hex meshes in the polyMesh file format of OpenFOAM.☆13Jan 2, 2013Updated 13 years ago
- ☆13Aug 12, 2019Updated 6 years ago
- Simple solution to make reporting on CWVs from BQ simpler to set up.☆11Feb 5, 2026Updated last month
- Some functions to plot OpenFOAM data with Matplotlib☆11Apr 15, 2021Updated 4 years ago
- Automatically load data from Google Cloud Storage files into Big Query tables☆11Dec 30, 2022Updated 3 years ago
- BigQuery Data Connector for Dremio☆12Sep 29, 2023Updated 2 years ago
- Unlocking the Power of SAM 2 for Few-Shot Segmentation (ICML 2025)☆28May 21, 2025Updated 9 months ago
- ☆10Mar 1, 2026Updated last week
- Alternative BigQuery for using multiple datasets☆12Mar 9, 2021Updated 5 years ago
- A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets…☆14Updated this week
- ☆11Apr 9, 2022Updated 3 years ago
- Create a flutter authenticate app in 10 mins by using firebase as the back-end. This repo will show you how to enable Firebase authentica…☆11Nov 7, 2021Updated 4 years ago
- Export data from Redshift to BigQuery☆12Mar 16, 2018Updated 7 years ago
- BigQuery Manager☆11Oct 2, 2020Updated 5 years ago
- ☆12Sep 5, 2023Updated 2 years ago
- Example of a Hangouts Chat Bot on Google Cloud Functions☆16Jan 16, 2019Updated 7 years ago
- learning-by-doing data model built with dbt-core☆15Dec 13, 2025Updated 2 months ago
- "adapTable" is an unofficial open source tool developed in python by Ovrsea in order to help other data teams administrate more efficient…☆13Apr 11, 2023Updated 2 years ago
- This repository will contain the code for Java backend developer bootcamp☆11Feb 6, 2025Updated last year