GoogleCloudPlatform / dataproc-pubsub-spark-streaming

Related projects ⓘ

Alternatives and complementary repositories for dataproc-pubsub-spark-streaming

• GoogleCloudDataproc / spark-spanner-connector
  Cloud Spanner Connector for Apache Spark
  ☆17Updated last week
• GoogleCloudPlatform / ci-cd-for-data-processing-workflow
  ☆46Updated 6 months ago
• GoogleCloudDataproc / cloud-dataproc
  Cloud Dataproc: Samples and Utils
  ☆199Updated last week
• GoogleCloudPlatform / datacatalog-connectors-hive
  Sample code with integration between Data Catalog and Hive data source.
  ☆25Updated 6 months ago
• samelamin / spark-bigquery
  Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
  ☆70Updated last year
• apache / airflow-ci
  Apache Airflow CI pipeline
  ☆18Updated 5 years ago
• GoogleCloudPlatform / spark-on-k8s-gcp-examples
  Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub
  ☆36Updated 6 years ago
• avensolutions / cdc-at-scale-using-spark
  Scalable CDC Pattern Implemented using PySpark
  ☆18Updated 5 years ago
• spotify / scio.g8
  A Giter8 template for scio
  ☆30Updated this week
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• GoogleCloudPlatform / dlp-dataflow-deidentification
  Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP
  ☆89Updated 3 months ago
• lightbend / model-serving-tutorial
  Code and presentation for Strata Model Serving tutorial
  ☆69Updated 5 years ago
• saikrishnapujari / Spark-Nested-Data-Parser
  Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark
  ☆15Updated 10 months ago
• maropu / spark-data-repair-plugin
  Provide functionality to build statistical models to repair dirty tabular data in Spark
  ☆12Updated last year
• GoogleCloudPlatform / bigquery-ingest-avro-dataflow-sample
  Stream Avro SpecificRecord objects in BigQuery using Cloud Dataflow
  ☆13Updated 2 years ago
• GoogleCloudPlatform / dataflow-sample-applications
  ☆127Updated 6 months ago
• GoogleCloudPlatform / bigquery-etl-dataflow-sample
  ☆64Updated 3 months ago
• ing-bank / rokku
  Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…
  ☆66Updated 9 months ago
• nikkatalnikov / bigkube
  Minikube for big data with Scala and Spark
  ☆15Updated 5 years ago
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 4 years ago
• GoogleCloudPlatform / dataflow-opinion-analysis
  Opinion Analysis of News, Threaded Conversations, and User Generated Content
  ☆102Updated 2 months ago
• zalando-incubator / spark-json-schema
  JSON schema parser for Apache Spark
  ☆81Updated 2 years ago
• ebonnal / delta-lake-ui
  UI to run SQL on Delta Lake tables and visualize the variations of the result among tables versions
  ☆11Updated 4 years ago
• dmatrix / examples
  These are some code examples
  ☆55Updated 4 years ago
• rockthejvm / spark-performance-tuning
  The official repository for the Rock the JVM Spark Optimization 2 course
  ☆37Updated 11 months ago
• GoogleCloudDataproc / custom-images
  Tools for creating Dataproc custom images
  ☆32Updated 2 weeks ago
• bartosz25 / spark-scala-playground
  Sample processing code using Spark 2.1+ and Scala
  ☆51Updated 4 years ago
• MrPowers / spark-test-example
  Spark DataFrame transformation and UDF test examples
  ☆23Updated last year
• DataStax-Examples / SparkBuildExamples
  Example projects for using Spark and Cassandra With DSE Analytics
  ☆58Updated last year
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆70Updated 2 years ago