alexvanboxel / pubsub-backup
☆27Updated 6 years ago
Alternatives and similar repositories for pubsub-backup:
Users that are interested in pubsub-backup are comparing it to the libraries listed below
- Processing Logs at Scale using Cloud Dataflow☆61Updated 6 years ago
- Ephemeral Hadoop clusters using Google Compute Platform☆135Updated 3 years ago
- A Kafka-Connect Sink for S3 with no Hadoop dependencies.☆57Updated 2 years ago
- *luigi-gcloud* is an luigi extension that enables full support for the Google Cloud Platform. Making it possible to do complex orchestrat…☆43Updated 8 years ago
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆152Updated last year
- ☆54Updated 7 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago
- [DEPRECATED] GAE python based app which regularly collects information about GCP resources and stores them in BigQuery☆45Updated last year
- This is the support code and solutions for the NYC Taxi Tycoon Dataflow Codelab☆61Updated 5 years ago
- Reporters and collectors for use in Google Cloud Platform☆91Updated 2 months ago
- Google BigQuery support for Spark, SQL, and DataFrames☆155Updated 5 years ago
- A service that autoscales Bigtable clusters based on CPU load☆68Updated 3 years ago
- DBeam exports SQL tables into Avro files using JDBC and Apache Beam☆195Updated this week
- Mirrors a Kinesis stream to Amazon S3 using the KCL☆42Updated 7 months ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.☆286Updated this week
- Tools for working with parquet, impala, and hive☆134Updated 4 years ago
- DataStax Enterprise running in a Docker Container☆47Updated 7 years ago
- ☆66Updated 8 months ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 5 years ago
- A fork of the Apache Kafka "connect-file" Kafka Connect, to use as a starting point to write your own Kafka connectors.☆37Updated 7 years ago
- Example Kubernetes app that shows how to build a 'pipeline' to stream data into BigQuery. Uses Redis or Google Cloud PubSub☆129Updated 4 years ago
- ☆35Updated 2 years ago
- Metrics collection library for Google Dataflow☆13Updated 6 years ago
- A Scala framework to build derived datasets, aka batch views, of Telemetry data.☆34Updated 2 years ago
- Open source tools for Google Cloud Storage and Databases.☆62Updated 11 months ago
- [SUNSET] Async Google Pubsub Client☆158Updated 2 years ago
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆147Updated 8 years ago
- ☆47Updated 11 months ago
- ☆22Updated 5 years ago