lucasbak / kafka-spark-streaming
Project for reading data from kafka and writing to kafka and HBase with kerberos
☆24Updated 8 years ago
Alternatives and similar repositories for kafka-spark-streaming:
Users that are interested in kafka-spark-streaming are comparing it to the libraries listed below
- Spark Streaming HBase Example☆22Updated 9 years ago
- Spark Streaming HBase Example☆95Updated 9 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Updated 8 years ago
- Spark code to analyze HBase Snapshots☆34Updated 7 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 8 years ago
- Java library to integrate Flink and Kudu☆54Updated 7 years ago
- A sink to save Spark Structured Streaming DataFrame into Hive table☆31Updated 7 years ago
- spark + drools☆102Updated 2 years ago
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆199Updated 7 years ago
- Apache Spark and Apache Kafka integration example☆124Updated 7 years ago
- ☆54Updated 10 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Updated 5 years ago
- Spark Structured Streaming Kafka 0.8 Source Implementation☆35Updated 7 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- Learning to write Spark examples☆159Updated 10 years ago
- High performance HBase / Spark SQL engine☆28Updated 2 years ago
- Examples of Spark 2.0☆211Updated 3 years ago
- ☆105Updated 5 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Updated 8 years ago
- Kafka stream for Spark with storage of the offsets in ZooKeeper☆60Updated 8 years ago
- Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficient…☆55Updated 2 years ago
- ☆102Updated 5 years ago
- Sample Spark Streaming application for secure consumption from Kafka☆33Updated 7 years ago
- Fluent client for interacting with Spark Standalone Mode's Rest API for submitting, killing and monitoring the state of jobs.☆110Updated 6 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆33Updated 6 years ago
- Spark connector for SFTP☆100Updated 2 years ago
- A Spark SQL HBase connector☆29Updated 9 years ago
- Spark, Spark Streaming and Spark SQL unit testing strategies☆218Updated 8 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆45Updated 7 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago