spark streaming从kafka读取消息,offset写入Redis,spark计算单词出现频率,最后写入hive表
☆17Jul 30, 2019Updated 7 years ago
Alternatives and similar repositories for spark-streaming-kafka-demo
Users that are interested in spark-streaming-kafka-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 请求spark rest API获取applications,jobs,stages,executors,rdds,streaming,environment等信息提供监控和报警服务☆11Nov 22, 2018Updated 7 years ago
- hive sql parser☆11Aug 27, 2014Updated 12 years ago
- 双端trie树的python实现☆11Jul 23, 2018Updated 8 years ago
- 大数据平台舆情分析系统前端模版☆28Jul 7, 2015Updated 11 years ago
- A simple shell envrioment to acces k8s resources☆11Nov 5, 2017Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Showing the relationship between ImageNet ID and labels and pytorch pre-trained model output ID and labels☆10Oct 11, 2020Updated 6 years ago
- Llama - Low Latency Application MAster☆35Jun 27, 2022Updated 4 years ago
- Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So …☆38Apr 19, 2017Updated 9 years ago
- FTP network server is source of events for Apache-flume☆80Apr 11, 2018Updated 8 years ago
- 思维导图分享☆12May 5, 2019Updated 7 years ago
- 微服务架构实战篇(五):Spring boot2.x + Guava 并使用RateLimiter秒杀限流☆12Mar 14, 2019Updated 7 years ago
- Multi-layer agent orchestration. PM plans, specialists execute.☆17May 24, 2026Updated 4 months ago
- A Language-Independent Unsupervised Morphological Segmentation Framework based on Adaptor Grammars☆18Jun 14, 2024Updated 2 years ago
- 识别水表读数☆20Mar 25, 2020Updated 6 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Another ERC20 token, bug free.☆11Jul 13, 2018Updated 8 years ago
- A logstash codec plugin for decoding and encoding Avro records☆15Jul 30, 2026Updated 2 months ago
- ☆10Updated this week
- A Statsd backend for sending metrics to Kafka☆18Apr 23, 2023Updated 3 years ago
- 🚀 Material-UI based Audio Player☆10Dec 2, 2022Updated 3 years ago
- 大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件☆40Mar 22, 2024Updated 2 years ago
- springboot和dubbo、netty的集成,spring-ai-*的集成,redis mongodb的nosql模板, kafka rocketmq rabbit的MQ模板, solr solrcloud elasticsearch查询引擎☆187Apr 7, 2026Updated 6 months ago
- docker-hadoop-spark-hive 快速构建你的大数据环境☆21Jan 4, 2020Updated 6 years ago
- Scripts for installing Hadoop, HBase, Hive, Pig & Spark.☆10Nov 13, 2019Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 常用大数据工具学习实战,包含Hadoop、HBase、Kafka、ClickHouse、Hive、Redis、Zookeeper...☆22Oct 5, 2022Updated 4 years ago
- the light HTTP server for accounting clicks (using in banner system)☆18May 27, 2011Updated 15 years ago
- 中文 Hacker News 速读:缓存、翻译并总结热门讨论 | Chinese-first HN reader with cached translations and discussion summaries.☆18Jul 11, 2026Updated 3 months ago
- 百家乐白鹭版☆11Jul 21, 2018Updated 8 years ago
- 第五次Druid meetup ppt集锦☆20Aug 7, 2017Updated 9 years ago
- PHP漏洞扫描器(PHP Vulnerability Scanner,PVS)是用于监测网站漏洞的安全扫描工具。☆12Nov 4, 2020Updated 5 years ago
- hadoop中Map/Reduce使用示例,输入(DBInputFormat),输出(DBOutputFormat)为MySql数据库表、日志分析Grep、单词排序Sort...对HBase的基本操作,增、删、查、改,使用Map/Reduce批量导入数据到HBase表中..…☆14Apr 6, 2013Updated 13 years ago
- Nine-Chapters: AwakenCN组织的数据结构与算法篇,强化数据结构与算法的基础知识,从而达到学以致用的目的,其次就是在跳槽可以拿到更好的offer。☆10Sep 11, 2020Updated 6 years ago
- 这是一个关于资产清算的区块链智能合约,基于HyperLedger Fabric 1.0 ,主要做机构,用户之间的清算交易。☆29May 2, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Kubenetes with SpringBoot demo☆10Feb 20, 2019Updated 7 years ago
- A dockerized small bigdata cluster to play with☆12Jun 14, 2016Updated 10 years ago
- ☆15Nov 14, 2020Updated 5 years ago
- 棋牌麻将参考☆10May 11, 2019Updated 7 years ago
- ☆12May 11, 2016Updated 10 years ago
- A simple project demonstrates the integration of Spring boot, ActiveMQ, Camel and STOMP☆11Aug 31, 2016Updated 10 years ago
- 最好的大数据项目。《Titan数据运营系统》,本项目是一个全栈闭环系统,我们有用作数据可视化的web系统,然后用flume-kafaka-flume进行日志的读取,在hive设计数仓,编写spark代码进行数仓表之间的转化以及ads层表到mysql的迁移,使用azkaban…☆149Nov 8, 2021Updated 4 years ago