NucleusEngineering / hack-your-pipeLinks
Efficient streaming data ingestion, transformation & activation
☆28Updated 2 years ago
Alternatives and similar repositories for hack-your-pipe
Users that are interested in hack-your-pipe are comparing it to the libraries listed below
Sorting:
- An end to end demo of Google's Cloud data and analytic stack.☆278Updated last month
- Cloud-native, data onboarding architecture for Google Cloud Datasets☆169Updated 2 weeks ago
- BigQuery DataFrames (also known as BigFrames)☆278Updated this week
- ☆42Updated last month
- Data Quality Engine for BigQuery☆279Updated 7 months ago
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆76Updated last year
- This repository contains an example of how to leverage Cloud Composer and Cloud Dataflow to move data from a Microsoft SQL Server to BigQ…☆19Updated 7 months ago
- Automatically discover and tag PII data across BigQuery tables and apply column-level access controls based on confidentiality level.☆61Updated 3 weeks ago
- A self-contained dbt project for testing purposes☆515Updated last year
- 🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.☆246Updated this week
- This dbt starter project template is using the Google Analytics 4 BigQuery exports as input for some practical examples / models to showc…☆40Updated 2 years ago
- This Dataform project processes various marketing data sources and creates a Marketing Data Store (MDS) to be used in several use cases: …☆76Updated 6 months ago
- ☆20Updated 3 weeks ago
- Data pipeline with dbt, Airflow, Great Expectations☆166Updated 4 years ago
- Dataproc templates and pipelines for solving in-cloud data tasks☆144Updated this week
- Tag Engine automates the process of creating, updating, deleting, and populating metadata in bulk with the Google Cloud services Data Cat…☆61Updated this week
- Data lake, data warehouse on GCP☆58Updated 4 years ago
- ☆37Updated last week
- One SDK to rule them all, and in the codegen bind them☆259Updated 2 weeks ago
- ☆19Updated 3 years ago
- Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.☆1,263Updated 2 weeks ago
- This repository has moved into https://github.com/dbt-labs/dbt-adapters☆258Updated 10 months ago
- ☆71Updated this week
- Queries to assist with BigQuery cost and performance.☆114Updated 3 weeks ago
- Package for dbt that allows users to train, audit and use BigQuery ML models.☆77Updated last month
- The Dataflow Solution Guides offer full end-to-end deployment for the most common streaming solutions to run on Dataflow.☆40Updated 2 months ago
- Utility to compare data between homogeneous or heterogeneous environments to ensure source and target tables match☆489Updated this week
- Get started with dbt in less than 1 minute from `git clone` to `dbt docs serve` for free!☆245Updated this week
- ☆146Updated last year
- dbt Package for modeling raw data exported by Google Analytics 4. BigQuery support, only.☆382Updated last month