Spark Streaming实时流处理项目实战
☆17Jul 12, 2025Updated last year
Alternatives and similar repositories for sparkstreaming
Users that are interested in sparkstreaming are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HBase操作封装的orm: easy-hbase,更方便的使用HBase☆19Jan 16, 2024Updated 2 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 9 years ago
- Java implementation of immutable key-value storage based on sorted string table☆12Jun 26, 2015Updated 11 years ago
- Demonstrates how one can integrate kafka, flink and cassandra with spring data. Please check the producer module in conjuction with the c…☆12Feb 25, 2016Updated 10 years ago
- 实时分析nginx日志，计算接口访问次数，uv，时延，异常IP等指标☆28Apr 14, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 在公司接了一个任务，完成一个项目数据同步的模块。要求是不能操作项目的数据库。怕操作不当，数据丢失。所以想到的方案是使用log4jdbc记录数据源的SQL语句到日志文件。然后按行读取日志文件中的数据，记录读取的Point，以便下次继续读取。读取的数据进入bigqueue队列，…☆12Aug 10, 2017Updated 9 years ago
- 高性能大数据实时同步:kafka连接器(kafka-connect-kudu-sink插件)、海量日志流处理☆19Jun 17, 2022Updated 4 years ago
- 1.Spark离线批处理，用户实时点击统计；2.SparkSQL日志内容分析；3.受众电影分析 =>（Kafka + SparkStreaming + Redis）和（Kafka + SparkStreaming + Mysql）☆29Jun 21, 2022Updated 4 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Oct 8, 2025Updated 10 months ago
- My blog☆15Oct 6, 2015Updated 10 years ago
- sparkStreaming项目，1.日志分析系统 2. 舆情管控系统之实时词频统计处理子系统（包括中文分词服务器）3. 网站用户行为统计系统（ 只统计用户行为，建模预测后期实现） 4. 网站安全实时监控报警系统。☆14Jul 1, 2022Updated 4 years ago
- Flink Hadoop Compatibility + Elasticsearch for Apache Hadoop = Flink Connector Elasticsearch Source Table。结合flink+hadoop+es 实现的es table s…☆20Jun 28, 2021Updated 5 years ago
- Programming in Hadoop and Spark☆13Jul 27, 2018Updated 8 years ago
- Hive for MR3☆41Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 基于Akka实现的数据实时流式同步的应用,支持高可用☆28Apr 25, 2019Updated 7 years ago
- A big data project for predicting prices of Uber/Lyft rides depending on the weather☆14Jan 27, 2026Updated 7 months ago
- Solution to Cartpole balancing problem with the help of reinforcement learning and Deep Neural Networks.☆11May 5, 2023Updated 3 years ago
- ☆13Apr 9, 2018Updated 8 years ago
- spring5中文注释版☆13Oct 13, 2019Updated 6 years ago
- 基于深度学习的文字识别系统☆11Aug 24, 2023Updated 3 years ago
- Chinese version of《Presto: The Definitive Guide》Presto 权威指南中文版☆17Apr 23, 2020Updated 6 years ago
- Collection of tutorials on text analytics/NLP, including vector space models, neural language models and topic models on the Pivotal MPP …☆17Apr 5, 2016Updated 10 years ago
- kafka传数据到Flink存储到mysql之Flink使用SQL语句聚合数据流（设置时间窗口，EventTime）☆31May 8, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 更新中（速度较慢）：大数据+AI的实用框架，每一步都有成就感！手把手实战（一步步/大量注释/操作配图），如企业画像（Spark+NLP）、推荐系统（Spark+GBDT/LR）、实时数仓（Flink）等，以实战学技术。☆27Jan 3, 2023Updated 3 years ago
- 杭州第六次 Spark & Flink Meetup☆30May 14, 2018Updated 8 years ago
- measure objects in augmented reality, using just your smartphone.☆16Aug 22, 2022Updated 4 years ago
- Helpful tools for monitoring Kafka Connect☆20Feb 20, 2018Updated 8 years ago
- 2019中国高校计算机大赛——大数据挑战赛TOP11解决方案☆15Aug 14, 2019Updated 7 years ago
- project practice☆13Nov 16, 2022Updated 3 years ago
- Automated (Ansible) installation of HDP via Ambari Blueprint☆16Mar 10, 2017Updated 9 years ago
- flink实时处理kafka传来的数据通过连接池技术写入hbase☆96Jul 18, 2022Updated 4 years ago
- A collection of examples illustrating data processing, data science, and machine learning on the Pivotal Greenplum and HAWQ MPP databases☆20Apr 26, 2016Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 一个大数据实时流处理日志分析系统 Demo☆30Nov 16, 2022Updated 3 years ago
- Code and data for COLING2024 paper "Characteristic AI Agents via Large Language Models".☆25Nov 29, 2024Updated last year
- Note anything during writing spark or scala☆20Sep 29, 2017Updated 8 years ago
- A report(chart) platform for enterprise data.☆22Nov 18, 2019Updated 6 years ago
- UCBerkely Spring 2020 CS186 side project.(B+ tree indices, efficient join algorithms, query optimization, multigranularity locking, datab…☆25Oct 12, 2020Updated 5 years ago
- contains of examples, notes, and projects on Spark☆18Aug 1, 2021Updated 5 years ago
- MIT 6.828 Operating System Engineering Fall 2018 Course☆51Mar 31, 2021Updated 5 years ago