☆14Nov 3, 2016Updated 9 years ago
Alternatives and similar repositories for Kafka-SparkStreaming-HDFS
Users that are interested in Kafka-SparkStreaming-HDFS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Streaming 相关项目☆15Mar 27, 2017Updated 9 years ago
- Spark Streaming HBase Example☆22Mar 16, 2016Updated 10 years ago
- spark流数据处理，可以从flume-ng，kafka接收数据☆11Sep 16, 2015Updated 10 years ago
- Spark Streaming example project which pulls messages from Kafka and write to HBase Table.☆11Jul 5, 2015Updated 10 years ago
- ☆12May 11, 2016Updated 9 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 使用spark streaming 导入kafka数据到hbase☆25Apr 14, 2016Updated 9 years ago
- conbine flume,spark-streaming and redis for real-time computing☆22Oct 20, 2014Updated 11 years ago
- An example project that combines Spark Streaming, Kafka, and Parquet to transform JSON objects streamed over Kafka into Parquet files in …☆19Jun 22, 2021Updated 4 years ago
- Using Spark SQLContext, HiveContext & Spark DataFrames API with ElasticSearch, Cassandra & MongoDB☆22Sep 13, 2016Updated 9 years ago
- Spark structured-streaming 消费kafka数据写入hbase☆33Jan 22, 2019Updated 7 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆44Aug 2, 2017Updated 8 years ago
- DirectKafka examples for Spark Streaming : 1. with checkpointing 2. Custom offset management☆60Sep 9, 2016Updated 9 years ago
- Use Scala API to read/write data from different databases,HBase,MySQL,etc.☆24Feb 28, 2018Updated 8 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆37Apr 19, 2017Updated 8 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Flume-to-Spark-Streaming Log Parser☆23Jun 3, 2016Updated 9 years ago
- Examples of Integrating Spark Streaming, Flume, and HBase to solve Streaming problems☆19Feb 27, 2014Updated 12 years ago
- A library to transform Scala product types and Schemes from different systems into other Schemes. Any implemented type automatically gets…☆14Mar 5, 2026Updated 3 weeks ago
- Apache-kafka-spark-streaming-poc☆10Mar 19, 2017Updated 9 years ago
- A maven project with codes of the book "Hadoop: The Definitive Guide(Fourth Edition)"☆10Jul 17, 2023Updated 2 years ago
- spark将hdfs数据高性能灌入kafka，然后spark streaming/structured streaming高速消费，关注性能，欢迎提供性能/代码优化建议☆32Mar 24, 2019Updated 7 years ago
- 基于jsqlparser 进行sql语句解析，得到字段间的血缘关系（即所查询字段来源于哪张表中的哪个字段）☆19Oct 6, 2023Updated 2 years ago
- A WIP Udemy downloader written in Go☆11Mar 20, 2022Updated 4 years ago
- A Spark SQL HBase connector☆29May 4, 2015Updated 10 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An example project using Spark Streaming with Kafka message and Avro serialization☆12Aug 21, 2015Updated 10 years ago
- ☆38Aug 19, 2015Updated 10 years ago
- Spark Streaming + kafka + hbase☆15Nov 19, 2018Updated 7 years ago
- Pandas Helper Library for reading and writing DataFrames from and to HBase.☆10Mar 8, 2018Updated 8 years ago
- PySpark-ETL☆22Dec 16, 2019Updated 6 years ago
- Spark Streaming HBase Example☆94Apr 4, 2016Updated 9 years ago
- ☆10Jun 7, 2020Updated 5 years ago
- Problems can be found over - https://www.hackerrank.com/domains/shell/bash/☆13Jan 20, 2015Updated 11 years ago
- 基于Spark的实时日志分析及异常检测系统 Flume + Kafka + Hbase + Spark-Streaming + Scala☆13Mar 12, 2019Updated 7 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- SparkStreaming项目，显示flume->Kafka->Spark->hbase(实时数据处理方案)，Scala实现☆36Feb 19, 2018Updated 8 years ago
- Learning Flink : Flink CEP,Flink Core,Flink SQL☆72Feb 21, 2022Updated 4 years ago
- Working example of consuming Avro data from Kafka with Spark Streaming☆12Feb 21, 2016Updated 10 years ago
- 大数据实习hdfs+flume+kafka+spark+hbase+hive项目☆35Jul 25, 2017Updated 8 years ago
- Code for processing AVRO data in Spark Streaming + Kafka (DirectKafka approach with custom offset management in zookeeper)☆29Sep 9, 2016Updated 9 years ago
- An analysis on Aadhaar dataset using Mapreduce and Spark☆14Feb 28, 2018Updated 8 years ago
- A subproject of Predictiveworks that provides common access to Cassandra, Elasticsearch, HBase, MongoDB, Parquet, JDBC database and other…☆13Feb 23, 2015Updated 11 years ago