Alternatives and similar repositories for gcp-ingestion:

Users that are interested in gcp-ingestion are comparing it to the libraries listed below

• GoogleCloudPlatform / dlp-dataflow-deidentification
  Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP
  ☆90Updated 6 months ago
• mozilla-services / mozilla-pipeline-schemas
  Schemas for Mozilla's data ingestion pipeline and data lake outputs
  ☆47Updated this week
• mozilla / telemetry-airflow
  Airflow configuration for Telemetry
  ☆185Updated this week
• GoogleCloudPlatform / bigquery-etl-dataflow-sample
  ☆66Updated 6 months ago
• mozilla / bigquery-etl
  Bigquery ETL
  ☆272Updated this week
• GoogleCloudPlatform / ci-cd-for-data-processing-workflow
  ☆46Updated 9 months ago
• GoogleCloudPlatform / datacatalog-connectors
  Commons code used by the Data Catalog connectors, and links for the connectors sample code.
  ☆61Updated 3 years ago
• GoogleCloudPlatform / dataflow-sample-applications
  ☆127Updated 9 months ago
• GoogleCloudPlatform / datacatalog-tag-engine
  Tag Engine automates the process of creating, updating, deleting, and populating metadata in bulk with the Google Cloud services Data Cat…
  ☆51Updated last month
• GoogleCloudPlatform / bigquery-data-lineage
  Reference implementation for real-time Data Lineage tracking for BigQuery using Audit Logs, ZetaSQL and Dataflow.
  ☆142Updated 8 months ago
• GoogleCloudPlatform / datacatalog-connectors-bi
  Sample code with integration between Data Catalog and BI data sources.
  ☆32Updated 3 years ago
• pabloem / awesome-beam
  A curated list of awesome resources for Apache Beam
  ☆146Updated 2 years ago
• spotify / spydra
  Ephemeral Hadoop clusters using Google Compute Platform
  ☆135Updated 2 years ago
• mozilla / lookml-generator
  LookML Generator for Glean and Mozilla Data
  ☆19Updated last week
• GoogleCloudDataproc / cloud-dataproc
  Cloud Dataproc: Samples and Utils
  ☆200Updated last month
• googleapis / python-dataproc
  This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-dataproc
  ☆48Updated last year
• googleapis / python-bigtable
  ☆69Updated this week
• googleapis / java-bigquerystorage
  ☆64Updated this week
• mesmacosta / datacatalog-util
  A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help lev…
  ☆21Updated 2 years ago
• GoogleCloudPlatform / datacatalog-connectors-hive
  Sample code with integration between Data Catalog and Hive data source.
  ☆25Updated 3 weeks ago
• GoogleCloudPlatform / datacatalog-connectors-rdbms
  Sample code with integration between Data Catalog and RDBMS data sources.
  ☆72Updated 3 years ago
• GoogleCloudPlatform / cloud-data-quality
  Data Quality Engine for BigQuery
  ☆264Updated 7 months ago
• GoogleCloudPlatform / bq-pii-classifier
  Automatically discover and tag PII data across BigQuery tables and apply column-level access controls based on confidentiality level.
  ☆49Updated last month
• GoogleCloudPlatform / public-datasets-pipelines
  Cloud-native, data onboarding architecture for Google Cloud Datasets
  ☆156Updated 3 weeks ago
• spotify / dbeam
  DBeam exports SQL tables into Avro files using JDBC and Apache Beam
  ☆194Updated this week
• googleapis / python-bigquery-datatransfer
  This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-bigquery-datatransfer
  ☆84Updated last year
• googleapis / java-bigtable
  ☆72Updated this week
• asaharland / beam-pipeline-examples
  Apache Beam examples for running on Google Cloud Dataflow.
  ☆30Updated 6 years ago
• mohaseeb / beam-nuggets
  Collection of transforms for the Apache beam python SDK.
  ☆89Updated last year
• GoogleCloudPlatform / dataproc-templates
  Dataproc templates and pipelines for solving simple in-cloud data tasks
  ☆123Updated last week