GoogleCloudPlatform / spark-examplesLinks
Spark pipelines that correspond to a series of Dataflow examples.
☆27Updated 6 years ago
Alternatives and similar repositories for spark-examples
Users that are interested in spark-examples are comparing it to the libraries listed below
Sorting:
- Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines. This re…☆167Updated 7 years ago
- Google BigQuery support for Spark, SQL, and DataFrames☆156Updated 6 years ago
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated 2 years ago
- ☆81Updated 2 years ago
- Interactive Audience Analytics with Spark and HyperLogLog☆55Updated 10 years ago
- Code for Packt Publishing's Scala Data Analysis Cookbook.☆48Updated 10 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Updated 8 years ago
- An example Apache Beam project.☆111Updated 8 years ago
- A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR☆120Updated 9 years ago
- Simple Spark example of generating table stats for use of data quality checks☆28Updated 8 years ago
- NRT Sessionization with Spark Streaming landing on HDFS and putting live stats in HBase☆50Updated 11 years ago
- An example of using Avro and Parquet in Spark SQL☆60Updated 10 years ago
- A tutorial on Apache Spark Unit Testing☆37Updated 10 years ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆108Updated 8 years ago
- A connector for SingleStore and Spark☆162Updated 4 months ago
- MLeap allows for easily putting Spark ML pipelines into production☆78Updated 9 years ago
- These are some code examples☆56Updated 6 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆94Updated 8 years ago
- ☆76Updated 10 years ago
- Examples for Fast Data Processing with Spark☆59Updated 12 years ago
- Coursera Machine Learning class examples in Spark☆43Updated 11 years ago
- Drizzle integration with Apache Spark☆120Updated 7 years ago
- an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore☆17Updated 8 years ago
- A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB☆93Updated 5 years ago
- Elastic Search on Spark☆112Updated 11 years ago
- Example project to show how to use Spark to read and write Avro/Parquet files☆50Updated 12 years ago
- Complete Pipeline Training at Big Data Scala By the Bay☆71Updated 10 years ago
- Building Scio from scratch step by step☆20Updated 6 years ago
- Spark Extension : ML transformers, SQL aggregations, etc that are missing in Apache Spark☆146Updated 10 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Updated 6 years ago