Alternatives and similar repositories for dataproc-pubsub-spark-streaming

Users that are interested in dataproc-pubsub-spark-streaming are comparing it to the libraries listed below

• GoogleCloudDataproc / spark-spanner-connector
  Cloud Spanner Connector for Apache Spark
  ☆17Updated 7 months ago
• GoogleCloudDataproc / cloud-dataproc
  Cloud Dataproc: Samples and Utils
  ☆204Updated 2 months ago
• samelamin / spark-bigquery
  Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
  ☆70Updated 2 years ago
• spotify / scio.g8
  A Giter8 template for scio
  ☆31Updated last week
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆70Updated this week
• funkyminds / cleanframes
  type-class based data cleansing library for Apache Spark SQL
  ☆78Updated 6 years ago
• GoogleCloudPlatform / datacatalog-connectors-hive
  Sample code with integration between Data Catalog and Hive data source.
  ☆24Updated 7 months ago
• GoogleCloudPlatform / spark-on-k8s-gcp-examples
  Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
  ☆37Updated 7 years ago
• GoogleCloudPlatform / ci-cd-for-data-processing-workflow
  ☆46Updated last year
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 6 years ago
• GoogleCloudPlatform / bigquery-etl-dataflow-sample
  ☆66Updated last year
• GoogleCloudDataproc / hadoop-connectors
  Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.
  ☆285Updated this week
• dmatrix / examples
  These are some code examples
  ☆55Updated 5 years ago
• GoogleCloudPlatform / bigquery-ingest-avro-dataflow-sample
  Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow
  ☆13Updated 3 years ago
• GoogleCloudPlatform / dataflow-sample-applications
  ☆130Updated last year
• GoogleCloudPlatform / dlp-dataflow-deidentification
  Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP
  ☆95Updated last year
• PacktPublishing / Building-Big-Data-Pipelines-with-Apache-Beam
  Building Big Data Pipelines with Apache Beam, published by Packt
  ☆86Updated 2 years ago
• saikrishnapujari / Spark-Nested-Data-Parser
  Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark
  ☆16Updated last year
• Talend / beam-samples
  ☆81Updated last year
• datamindedbe / lighthouse
  Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…
  ☆61Updated 11 months ago
• MrPowers / spark-test-example
  Spark DataFrame transformation and UDF test examples
  ☆22Updated 2 years ago
• GoogleCloudPlatform / pubsub
  This repository contains open-source projects managed by the owners of Google Cloud Pub/Sub.
  ☆255Updated 2 weeks ago
• thesamet / sparksql-scalapb-test
  Test for SparkSQL ScalaPB
  ☆14Updated 3 years ago
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆76Updated last year
• rockthejvm / spark-performance-tuning
  The official repository for the Rock the JVM Spark Optimization 2 course
  ☆40Updated last year
• spotify / spark-bigquery
  Google BigQuery support for Spark, SQL, and DataFrames
  ☆155Updated 5 years ago
• GoogleCloudDataproc / spark-bigquery-connector
  BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.
  ☆406Updated this week
• godatadriven / iterative-broadcast-join
  The iterative broadcast join example code.
  ☆70Updated 7 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 6 years ago
• target / data-validator
  A tool to validate data, built around Apache Spark.
  ☆100Updated last week