NucleusEngineering / hack-your-pipe
Efficient streaming data ingestion, transformation & activation
☆28Updated 2 years ago
Alternatives and similar repositories for hack-your-pipe
Users that are interested in hack-your-pipe are comparing it to the libraries listed below
Sorting:
- An end to end demo of Google's Cloud data and analytic stack.☆245Updated this week
- This dbt starter project template is using the Google Analytics 4 BigQuery exports as input for some practical examples / models to showc…☆38Updated last year
- Automatically discover and tag PII data across BigQuery tables and apply column-level access controls based on confidentiality level.☆55Updated 3 weeks ago
- Dataproc templates and pipelines for solving in-cloud data tasks☆128Updated last month
- A DBT example project demonstrating data modelling transformations for the standard-format Google Analytics 4 BigQuery Export☆34Updated last year
- 🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.☆162Updated last week
- This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering so…☆22Updated last year
- ☆34Updated last week
- This Dataform project processes various marketing data sources and creates a Marketing Data Store (MDS) to be used in several use cases: …☆69Updated last month
- This repository contains an example of how to leverage Cloud Composer and Cloud Dataflow to move data from a Microsoft SQL Server to BigQ…☆19Updated 11 months ago
- The Dataflow Solution Guides offer full end-to-end deployment for the most common streaming solutions to run on Dataflow.☆32Updated last month
- Tag Engine automates the process of creating, updating, deleting, and populating metadata in bulk with the Google Cloud services Data Cat…☆54Updated this week
- Data Quality Engine for BigQuery☆273Updated 10 months ago
- ☆25Updated 5 months ago
- ☆18Updated 3 weeks ago
- ☆61Updated this week
- ☆120Updated this week
- Cloud-native, data onboarding architecture for Google Cloud Datasets☆159Updated 2 months ago
- BigQuery DataFrames☆244Updated this week
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- ☆35Updated 5 months ago
- The go to demo for public and private dbt Learn☆77Updated last month
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆69Updated last year
- A curated list of awesome public DBT projects☆128Updated last year
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆83Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆77Updated 2 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆162Updated 3 years ago
- ☆19Updated 2 years ago
- A template DBT project for BigQuery on Google Cloud☆12Updated 4 years ago
- Package for dbt that allows users to train, audit and use BigQuery ML models.☆69Updated 3 months ago