基于webmagic + springboot + mybatis的Java爬虫，使用Echarts进行数据可视化分析，提供了从爬虫获取数据到数据持久化、数据可视化分析以及构建简单的代理池等一整套解决方案模板。
☆366Oct 26, 2017Updated 9 years ago
Alternatives and similar repositories for MagicToe
Users that are interested in MagicToe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- "奇伢爬虫"是基于sprint boot 、 WebMagic 实现 微信公众号文章、新闻、csdn、info等网站文章爬取，可以动态设置文章爬取规则、清洗规则，基本实现了爬取大部分网站的文章。☆323Sep 3, 2017Updated 9 years ago
- 一个基于webmagic框架二次开发的java爬虫框架实战，已实现能爬取腾讯，搜狐，今日头条（单独集成功能）等资讯内容，配合elasticsearch框架用法，实现了自动爬虫，已投入线上生产使用。☆338Nov 16, 2022Updated 3 years ago
- A simple and flexible web crawler framework for java.☆20Apr 22, 2018Updated 8 years ago
- 天气爬虫（全国城镇天气自动定时抓取更新，并开放RESTful查询接口），附带代理IP池定时更新并检测其可用性☆363Jun 25, 2018Updated 8 years ago
- 使用WebMagic抓取招聘信息，并且持久化到Mysql的例子。☆220Nov 22, 2016Updated 9 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 拉勾网爬虫及数据可视化项目☆12May 17, 2022Updated 4 years ago
- 数据可视化平台☆345Jun 30, 2018Updated 8 years ago
- 基于 webmagic 的 Java 爬虫应用☆2,765Jan 8, 2022Updated 4 years ago
- ☆100May 27, 2025Updated last year
- 爬虫代理IP池服务，可供其他爬虫程序通过restapi获取☆115Oct 13, 2026Updated 3 weeks ago
- A configurable web spider with a easy-to-use web console☆996Jun 3, 2026Updated 5 months ago
- 数仓实时项目☆10May 9, 2019Updated 7 years ago
- 利用spring boot + webmagic 开发的java爬虫系统☆60Dec 29, 2016Updated 9 years ago
- flink对于机器学习库的更新还不是特别完善，另外工作的需要。所以自己实现了几个机器学习算法用flink☆11Mar 30, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- IoT数据分析系统 springboot+springsecurity+mybatis+kafka+ECharts+adminLTE☆12Aug 31, 2024Updated 2 years ago
- A scalable web crawler framework for Java.☆11,668Dec 20, 2025Updated 10 months ago
- 使用kafka实现log4j日志集中管理☆14Jan 6, 2021Updated 5 years ago
- 整合报表工具☆11Oct 20, 2017Updated 9 years ago
- DBMetadata数据库元数据☆94May 7, 2018Updated 8 years ago
- 一个简单、敏捷、分布式的支持SpringBoot的Java爬虫框架;An agile, distributed crawler framework.☆1,986Oct 15, 2026Updated 3 weeks ago
- 股票交易数据处理的整个业务流程 数据源--->数据采集--->数据归类--->数据储存--->数据分析--->数据可视化☆31Nov 23, 2016Updated 9 years ago
- an data-centric government platform☆10Aug 25, 2021Updated 5 years ago
- 论坛日志分析系统清洗程序(包含IP规则库，UDF开发，MapReduce程序，日志数据)☆32May 18, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 基于 Java 17、Spring Cloud Alibaba、Nacos 与 Vben Admin 5 的多商家商城微服务项目。☆204Oct 28, 2026Updated last week
- Echarts get data from database. Echarts 从数据库中获取动态数据。 The project can run on both eclipse and idea.☆10Oct 18, 2017Updated 9 years ago
- 豆瓣爬虫 爬取热门标签、图书信息、图书评论 系统架构 Webmagic+SSM+Redis+Mysql+ActiveMQ+Druid☆44Apr 24, 2019Updated 7 years ago
- 给爬虫使用的代理IP池☆562Sep 6, 2019Updated 7 years ago
- Anoyi's website☆1,095Dec 29, 2025Updated 10 months ago
- Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志分析统计；SpringBoot+Echarts实现数据可视化展示☆513Jul 25, 2018Updated 8 years ago
- ☆16Feb 9, 2017Updated 9 years ago
- Docker resources and projects☆15Mar 24, 2018Updated 8 years ago
- echarts大屏展示得数据可视化☆11Sep 6, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 基于sqoop封装的一个通用的抽取工具，方便数据平台界面提交任务以及数据源管理☆10May 2, 2017Updated 9 years ago
- SpringBoot+Solr + webmagic JD商品爬取数据，放入solr中做搜索，学习下solr使用☆45Aug 31, 2017Updated 9 years ago
- 基于JavaEE开源、轻量级的企业敏捷开发与管理平台☆19Feb 22, 2023Updated 3 years ago
- 基于SpringBoot的后端server脚手架，集成MyBatis、Shiro等☆16Oct 13, 2021Updated 5 years ago
- 可视化爬虫自动采集平台☆185Feb 27, 2023Updated 3 years ago
- zhihu-crawler是一个基于Java的高性能、支持免费http代理池、支持横向扩展、分布式爬虫项目☆918Apr 2, 2019Updated 7 years ago
- 该工具作用是快速造数据，按照你想要的规则将造好的测试数据存入csv,方便postman，jmeter等工具做接口自动化 我们知道当我们做接口自动化的时候，制作入参的csv表格手动填写很麻烦，特别是当项目某个字段的规则变了以后，那么所有涉及到这个字段的正常和异常用例数据可能都…☆13May 18, 2019Updated 7 years ago