verilylifesciences / purplequery
An open source library for BigQuery testing.
☆14Updated 2 years ago
Alternatives and similar repositories for purplequery:
Users that are interested in purplequery are comparing it to the libraries listed below
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated last year
- Python utilities for BigQuery analyses.☆15Updated 4 years ago
- ☆54Updated 7 years ago
- A command-line tool for managing permissions and dependencies for BigQuery authorized views☆89Updated 2 years ago
- Google BigQuery support for Spark, SQL, and DataFrames☆155Updated 5 years ago
- Hive Storage Handler for interoperability between BigQuery and Apache Hive☆19Updated this week
- ☆46Updated 8 months ago
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- DBeam exports SQL tables into Avro files using JDBC and Apache Beam☆193Updated this week
- ☆13Updated 3 months ago
- Sample code with integration between Data Catalog and BI data sources.☆32Updated 2 years ago
- Commons code used by the Data Catalog connectors, and links for the connectors sample code.☆61Updated 3 years ago
- Update a Google Data Catalog tag with dbt Cloud run metadata☆22Updated 4 years ago
- A Giter8 template for scio☆30Updated 2 months ago
- GCS support for avro-tools, parquet-tools and protobuf☆74Updated this week
- Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and…☆28Updated last year
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 3 years ago
- Data Catalog Tag Templates☆30Updated 3 months ago
- Automatically discover and tag PII data across BigQuery tables and apply column-level access controls based on confidentiality level.☆47Updated 2 weeks ago
- Historical metadata of your data warehouse is a treasure trove to discover not just insights about changing data patterns, but also quali…☆13Updated 3 years ago
- JSON schema parser for Apache Spark☆81Updated 2 years ago
- Create backups of BigQuery datasets/tables☆40Updated last year
- Utility to identify and rewrite common anti patterns in BigQuery SQL syntax☆86Updated 2 months ago
- Sample code with integration between Data Catalog and Hive data source.☆25Updated this week
- Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow☆58Updated 4 years ago
- An application that uses Cloud Dataflow and Cloud Build to copy/transfer BigQuery tables between locations/regions.☆14Updated 3 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 5 years ago
- Visualize dependencies between Airflow DAGs☆49Updated 3 years ago
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆146Updated 8 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆135Updated 2 years ago