NucleusEngineering / hack-your-pipeLinks
Efficient streaming data ingestion, transformation & activation
☆28Updated 2 years ago
Alternatives and similar repositories for hack-your-pipe
Users that are interested in hack-your-pipe are comparing it to the libraries listed below
Sorting:
- ☆35Updated last week
- Tag Engine automates the process of creating, updating, deleting, and populating metadata in bulk with the Google Cloud services Data Cat…☆54Updated last week
- This Dataform project processes various marketing data sources and creates a Marketing Data Store (MDS) to be used in several use cases: …☆70Updated 2 months ago
- DMT is an end to end automation of data warehouse migration, focused on extraction, SQL translation, data migration, data validation, etc…☆35Updated 3 weeks ago
- Automatically discover and tag PII data across BigQuery tables and apply column-level access controls based on confidentiality level.☆56Updated this week
- This dbt starter project template is using the Google Analytics 4 BigQuery exports as input for some practical examples / models to showc…☆38Updated 2 years ago
- Cloud-native, data onboarding architecture for Google Cloud Datasets☆160Updated 4 months ago
- ☆62Updated last week
- Queries to assist with BigQuery cost and performance.☆88Updated 2 weeks ago
- ☆18Updated 2 months ago
- Data Quality Engine for BigQuery☆275Updated last month
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆69Updated last year
- An end to end demo of Google's Cloud data and analytic stack.☆253Updated last week
- BigQuery DataFrames (also known as BigFrames)☆251Updated this week
- Dataproc templates and pipelines for solving in-cloud data tasks☆129Updated this week
- The Dataflow Solution Guides offer full end-to-end deployment for the most common streaming solutions to run on Dataflow.☆33Updated last week
- ☆35Updated 6 months ago
- ☆49Updated this week
- A DBT example project demonstrating data modelling transformations for the standard-format Google Analytics 4 BigQuery Export☆34Updated last year
- ☆138Updated 7 months ago
- This project leverages GCS, Composer, Dataflow, BigQuery, and Looker on Google Cloud Platform (GCP) to build a robust data engineering so…☆25Updated last year
- Data Foundation - Google Cloud Cortex Framework☆192Updated last week
- 🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.☆182Updated last week
- Get started with dbt in less than 1 minute from `git clone` to `dbt docs serve` for free!☆203Updated last month
- ☆19Updated 2 years ago
- One SDK to rule them all, and in the codegen bind them☆243Updated last week
- ☆29Updated last year
- Dataform Tools - VS Code extension to run and visualise Dataform data pipelines and much more☆60Updated last week
- Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow☆43Updated this week
- ☆120Updated 3 weeks ago