A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB
☆94Oct 1, 2020Updated 5 years ago
Alternatives and similar repositories for spark-streaming-example-project
Users that are interested in spark-streaming-example-project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Spark WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR☆119Mar 28, 2016Updated 10 years ago
- An AWS Lambda function in Scala reading events from Amazon Kinesis and writing event counts to DynamoDB☆56Jan 25, 2016Updated 10 years ago
- UNRELEASED. An opinionated framework for analytics-on-write on event streams using key-value storage☆14Sep 10, 2015Updated 10 years ago
- An example project using Spark Streaming with Kafka message and Avro serialization☆12Aug 21, 2015Updated 11 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Feb 21, 2014Updated 12 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆55Aug 21, 2014Updated 12 years ago
- Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe☆15Jan 28, 2018Updated 8 years ago
- Hadoop InputFormat for http://druid.io/☆10Oct 26, 2016Updated 9 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- ☆48Feb 4, 2018Updated 8 years ago
- ☆24Apr 29, 2016Updated 10 years ago
- Tutorial programs that illustrate how to use scala-virtualized☆23Aug 28, 2019Updated 7 years ago
- Unix tee, but for Kinesis streams☆12Oct 19, 2021Updated 4 years ago
- ☆14Jun 27, 2017Updated 9 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Basketball Statistics Demo☆11Oct 18, 2016Updated 9 years ago
- Write your Spark data to Kafka seamlessly☆172Jul 10, 2024Updated 2 years ago
- Low level integration of Spark and Kafka☆129Mar 15, 2018Updated 8 years ago
- Large-scale event processing with Akka Persistence and Apache Spark☆271Jun 18, 2016Updated 10 years ago
- Apache Spark and Apache Kafka integration example☆122Dec 21, 2017Updated 8 years ago
- Example project to show how to use Kafka from Spark Streaming with the Confluent schema registry☆11Aug 17, 2016Updated 10 years ago
- NRT Sessionization with Spark Streaming landing on HDFS and putting live stats in HBase☆50Oct 31, 2014Updated 11 years ago
- Implementation of classic distributed algorithms: membership, failure detection, quorum, replication etc.☆12Jan 12, 2020Updated 6 years ago
- Amazon Kinesis Aggregators provides a simple way to create real time aggregations of data on Amazon Kinesis.☆151Apr 30, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Example of use of Spark Streaming with Kafka☆89Jul 11, 2014Updated 12 years ago
- 99 Scala problems (http://aperiodic.net/phil/scala/s-99/) solved in Scala☆55Apr 19, 2019Updated 7 years ago
- Starter project for building MemSQL Streamliner Pipelines☆32Apr 18, 2017Updated 9 years ago
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆631Apr 24, 2026Updated 4 months ago
- SBT plugin for creating and managing AWS CloudFormation stacks☆11Jan 8, 2018Updated 8 years ago
- Spark Streaming HBase Example☆94Apr 4, 2016Updated 10 years ago
- An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …☆19Jun 22, 2021Updated 5 years ago
- Quick benchmark comparing Protocol Buffers 3 vs Jackson JSON☆14Jul 3, 2015Updated 11 years ago
- Implementation of Paxos☆21Apr 4, 2015Updated 11 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Embedded Kafka for testing and quick prototyping.☆14Apr 19, 2016Updated 10 years ago
- ☆241Jun 14, 2018Updated 8 years ago
- Files to help make new spark EMR Bootstraps☆15Aug 4, 2013Updated 13 years ago
- Scripts to benchmark distributed Alternative Least Squares (ALS)☆22Jul 19, 2014Updated 12 years ago
- Spark Elastic MapReduce bootstrap and runnable examples.☆17Jun 26, 2013Updated 13 years ago
- A solution describing data-processing design pattern for streaming data through Kinesis and Spark Streaming at real-time.☆39Jun 11, 2024Updated 2 years ago
- Akka Cluster for Value-at-Risk calculation☆13May 2, 2014Updated 12 years ago