zendesk / scala-flowLinks
A lightweight library intended to make developing Google DataFlow jobs in Scala easier.
☆14Updated 5 years ago
Alternatives and similar repositories for scala-flow
Users that are interested in scala-flow are comparing it to the libraries listed below
Sorting:
- Building Scio from scratch step by step☆20Updated 6 years ago
- DBeam exports SQL tables into Avro files using JDBC and Apache Beam☆194Updated last month
- Libraries and tools for interoperability between Hadoop-related open-source software and Google Cloud Platform.☆288Updated this week
- Ephemeral Hadoop clusters using Google Compute Platform☆134Updated 3 years ago
- GCS support for avro-tools, parquet-tools and protobuf☆77Updated 6 months ago
- Google BigQuery support for Spark, SQL, and DataFrames☆155Updated 5 years ago
- A Giter8 template for scio☆31Updated last week
- Open source tools for Google Cloud Storage and Databases.☆63Updated last year
- CDAP Kubernetes Operator☆19Updated last week
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated 2 years ago
- A tool for data sampling, data generation, and data diffing☆345Updated 7 months ago
- Tool to import Search Ads 360 Webquery report into BigQuery☆16Updated 2 years ago
- POC: Spark consumer for bottledwater-pg Kafka Avro topics☆16Updated 5 years ago
- Commons code used by the Data Catalog connectors, and links for the connectors sample code.☆61Updated 4 years ago
- Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow☆58Updated 5 years ago
- Runs JVM closures in Docker containers on Kubernetes☆36Updated 7 years ago
- Scala rules for Bazel☆377Updated 2 weeks ago
- Cloud Spanner Connector for Apache Spark☆17Updated last week
- [DEPRECATED] GAE python based app which regularly collects information about GCP resources and stores them in BigQuery☆45Updated 2 years ago
- QA dashboard for DV360 advertisers☆13Updated 4 years ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆108Updated 7 years ago
- Examples of how to use Cloud Bigtable both with GCE map/reduce as well as stand alone applications.☆232Updated 4 months ago
- ☆75Updated this week
- This repository contains open-source projects managed by the owners of Google Cloud Pub/Sub.☆257Updated 3 months ago
- Fixed-width data source for Spark SQL and DataFrames☆10Updated 9 years ago
- Scala Aggregators used for ML Model metrics monitoring☆91Updated 2 years ago
- ☆66Updated last year
- A Scala feature transformation library for data science and machine learning☆469Updated 9 months ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- Scala extensions for the Kryo serialization library☆617Updated last year