SignifAi / Spark-PubSubLinks
Google Cloud Pubsub connector for Spark Streaming
☆17Updated 4 years ago
Alternatives and similar repositories for Spark-PubSub
Users that are interested in Spark-PubSub are comparing it to the libraries listed below
Sorting:
- Google BigQuery support for Spark, SQL, and DataFrames☆156Updated 6 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 6 years ago
- Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.☆290Updated this week
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines. This re…☆167Updated 7 years ago
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆152Updated 9 years ago
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆152Updated last year
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated 2 years ago
- ☆81Updated 2 years ago
- Gallery of Apache Zeppelin notebooks☆216Updated 6 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆93Updated 5 years ago
- Oozie Workflow to Airflow DAGs migration tool☆90Updated last month
- Examples of how to use Cloud Bigtable both with GCE map/reduce as well as stand alone applications.☆232Updated 2 weeks ago
- A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR☆120Updated 9 years ago
- Run in all nodes of your cluster before the cluster starts - lets you customize your cluster☆600Updated 2 weeks ago
- Serverless proxy for Spark cluster☆324Updated 5 years ago
- ☆54Updated 8 years ago
- Cloud Dataproc: Samples and Utils☆206Updated last month
- A tutorial on Apache Spark Unit Testing☆37Updated 10 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 8 years ago
- Docker build for Zeppelin, a web-based Spark notebook☆221Updated 6 years ago
- Examples of Spark 2.0☆212Updated 4 years ago
- An example Apache Beam project.☆111Updated 8 years ago
- Spark connector for SFTP☆98Updated 2 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆94Updated 8 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆176Updated 8 months ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 6 years ago
- Spark ML Lib serving library☆48Updated 7 years ago
- ☆75Updated 5 years ago