fonylew / simple-cloud-functions-to-bigquery
Cloud Functions streaming insert to BigQuery (with Cloud Pub/Sub trigger). In this example, the function will make a REST API call to get a data and insert to BigQuery.
☆26Updated last year
Related projects ⓘ
Alternatives and complementary repositories for simple-cloud-functions-to-bigquery
- Dataproc templates and pipelines for solving simple in-cloud data tasks☆118Updated this week
- This dbt starter project template is using the Google Analytics 4 BigQuery exports as input for some practical examples / models to showc…☆36Updated last year
- ☆32Updated 7 months ago
- Workspace for dbt demos☆58Updated last year
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆110Updated 3 months ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆167Updated last year
- A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.☆179Updated 4 months ago
- An end to end demo of Google's Cloud data and analytic stack.☆224Updated last week
- Utility to identify and rewrite common anti patterns in BigQuery SQL syntax☆83Updated this week
- Data lake, data warehouse on GCP☆54Updated 2 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆110Updated last year
- ☆111Updated last month
- Data Quality Engine for BigQuery☆258Updated 3 months ago
- A Looker block for analysing Google Cloud Platform Billing and BigQuery data access logs☆35Updated 2 years ago
- ☆138Updated 2 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆158Updated 3 years ago
- Cloned by the `dbt init` task☆59Updated 6 months ago
- This Dataform project processes various marketing data sources and creates a Marketing Data Store (MDS) to be used in several use cases: …☆63Updated this week
- A DBT example project demonstrating data modelling transformations for the standard-format Google Analytics 4 BigQuery Export☆27Updated 8 months ago
- Run dbt serverless in the Cloud (AWS)☆38Updated 4 years ago
- ☆46Updated 6 months ago
- dbt-bigquery contains all of the code required to make dbt operate on a BigQuery database.☆219Updated this week
- Template for Data Engineering and Data Pipeline projects☆104Updated last year
- Repo for saving cheat sheets☆42Updated 5 months ago
- ☆51Updated last year
- 🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.☆111Updated last month
- Data Catalog Tag Templates☆29Updated last month
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆63Updated 6 months ago
- Code Repository for my 1st Data Project.☆21Updated last year
- Run and schedule dbt commands using Github Actions☆65Updated 6 months ago