Alternatives and similar repositories for gcp-ingestion

Users that are interested in gcp-ingestion are comparing it to the libraries listed below

• GoogleCloudPlatform / dlp-dataflow-deidentification
  Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP
  ☆92Updated 9 months ago
• mozilla-services / mozilla-pipeline-schemas
  Schemas for Mozilla's data ingestion pipeline and data lake outputs
  ☆48Updated this week
• GoogleCloudPlatform / dataflow-sample-applications
  ☆128Updated last year
• GoogleCloudPlatform / ci-cd-for-data-processing-workflow
  ☆47Updated last year
• mozilla / telemetry-airflow
  Airflow configuration for Telemetry
  ☆186Updated this week
• mozilla / bigquery-etl
  Bigquery ETL
  ☆298Updated this week
• GoogleCloudPlatform / bigquery-etl-dataflow-sample
  ☆66Updated 9 months ago
• GoogleCloudPlatform / datacatalog-tag-engine
  Tag Engine automates the process of creating, updating, deleting, and populating metadata in bulk with the Google Cloud services Data Cat…
  ☆54Updated this week
• GoogleCloudPlatform / datacatalog-connectors-rdbms
  Sample code with integration between Data Catalog and RDBMS data sources.
  ☆72Updated 3 years ago
• googleapis / python-dataproc
  This library has moved to https://github.com/googleapis/google-cloud-python/tree/main/packages/google-cloud-dataproc
  ☆48Updated last year
• mesmacosta / datacatalog-util
  A Python package to centralize some Google Cloud Data Catalog scripts, this repo contains commands like bulk CSV operations that help lev…
  ☆22Updated 2 years ago
• GoogleCloudPlatform / dataproc-templates
  Dataproc templates and pipelines for solving in-cloud data tasks
  ☆128Updated last month
• GoogleCloudPlatform / looker-hosting-reference-implementations
  ☆29Updated last year
• GoogleCloudPlatform / datacatalog-connectors-hive
  Sample code with integration between Data Catalog and Hive data source.
  ☆25Updated 3 months ago
• googleapis / java-bigquerystorage
  ☆69Updated this week
• mozilla / docker-etl
  Collection of dockerized ETL jobs managed by data engineering.
  ☆20Updated last week
• GoogleCloudPlatform / auto-data-tokenize
  Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow
  ☆43Updated 2 weeks ago
• mozilla / data-docs
  A guide for Mozilla's developers and data scientists to analyze and interpret the data gathered by our data collection systems.
  ☆89Updated last week
• google / dwh-migration-tools
  ☆48Updated this week
• GoogleCloudPlatform / bq-pii-classifier
  Automatically discover and tag PII data across BigQuery tables and apply column-level access controls based on confidentiality level.
  ☆55Updated 3 weeks ago
• GoogleCloudPlatform / bigquery-ingest-avro-dataflow-sample
  Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow
  ☆13Updated 3 years ago
• spotify / dbeam
  DBeam exports SQL tables into Avro files using JDBC and Apache Beam
  ☆196Updated last week
• GoogleCloudPlatform / datacatalog-templates
  Data Catalog Tag Templates
  ☆30Updated this week
• data-integrations / database-plugins
  Database plugins
  ☆14Updated last week
• GoogleCloudPlatform / public-datasets-pipelines
  Cloud-native, data onboarding architecture for Google Cloud Datasets
  ☆159Updated 2 months ago
• googleapis / java-bigtable
  ☆76Updated this week
• mozilla / lookml-generator
  LookML Generator for Glean and Mozilla Data
  ☆20Updated this week
• google / grizzly
  End-to-end DataOps platform deployed by Terraform.
  ☆66Updated last month
• GoogleCloudPlatform / pontem
  Open source tools for Google Cloud Storage and Databases.
  ☆62Updated last year
• googleapis / java-pubsublite-spark
  ☆17Updated 7 months ago