狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑 an enterprise-grade public opinion news crawler project: supports one-click operation of any number of crawlers, scheduled crawler tasks, batch deletion of crawlers; one-click deployment of crawlers
☆689May 23, 2026Updated 5 months ago
Alternatives and similar repositories for NewsCrawl
Users that are interested in NewsCrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 思通舆情 是一款开源免费的舆情系统，支持本地化部署。支持对海量的舆情数据进行多维交叉分析和深度挖掘,为用户户提供全面的舆情数据,专业的舆情分析。☆627Jan 4, 2023Updated 3 years ago
- spider-admin-pro 一个集爬虫Scrapy+Scrapyd爬虫项目查看 和 爬虫任务定时调度的可视化管理工具，SpiderAdmin的升级版☆612Jun 15, 2026Updated 4 months ago
- 帮助爬虫通过点选验证及滑动验证, 验证码识别☆98Sep 14, 2022Updated 4 years ago
- 澎湃新闻，新浪新闻，腾讯新闻，搜狐新闻，新闻联播，泰晤士报，纽约时报，BBCNews，旨在爬取所有新闻门户网站的新闻，禁止将所得数据商用！☆470Oct 18, 2022Updated 4 years ago
- 🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSpider、Spider、TaskSpider、BatchSpider四种爬…☆3,736Aug 21, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 新闻网页正文通用抽取器 Beta 版.☆3,806Apr 21, 2026Updated 6 months ago
- 一个新闻政策类爬虫项目，实现上万网站的实时监控、爬取、过滤、存储，具有高可用性和可扩展性。☆44Oct 12, 2022Updated 4 years ago
- 基于微博数据的舆情分析项目，包括微博爬虫、LDA主题分析和情感分析。☆1,057Oct 24, 2026Updated 2 weeks ago
- 基于scrapy的新闻爬虫☆104Apr 18, 2020Updated 6 years ago
- 神奇的蜘蛛🕷，一个几乎适用于所有web端站点的采集方案☆346Aug 23, 2022Updated 4 years ago
- 基于LDA+SVM可拓展的短文本分类。股市舆情监控系统☆29Nov 1, 2019Updated 7 years ago
- 互联网舆情企业风险事件的识别和预警，将公司名称进行实体提取，对新闻进行舆情分类，比赛地址为：http://ailab.aiwin.org.cn/competitions/48#learn_the_details☆21May 16, 2021Updated 5 years ago
- 使用百度开源ppyolo3目标检测模型识别滑动验证码 极验滑块验证码 识别成功率99% 🎯☆87Oct 21, 2021Updated 5 years ago
- K 哥爬虫代码分享，JS 逆向，爬虫进阶。关注公众号：K哥爬虫☆1,383May 12, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- JS逆向Hook工具集，开源部分工具到这里☆382Jul 30, 2023Updated 3 years ago
- 微信公众号文章的爬虫☆3,483Apr 18, 2024Updated 2 years ago
- 天眼查爬虫&企查查爬虫，指定关键字爬取公司信息☆735Feb 16, 2023Updated 3 years ago
- 开源微信爬虫：爬取公众号所有 文章、阅读量、点赞量和评论内容。易部署。持续维护！！！☆2,989Aug 28, 2026Updated 2 months ago
- 一个可以跑js的逆向工具。☆568Jun 28, 2023Updated 3 years ago
- Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架☆12,295Feb 10, 2026Updated 8 months ago
- 新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。☆11,360Jun 14, 2023Updated 3 years ago
- 各种爬虫：爱企查爬虫，网上114企业信息爬虫，抖音视频爬虫，wipo爬虫， 专利信息爬虫（patentscope）☆90May 27, 2026Updated 5 months ago
- 实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛…☆5,772May 22, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…☆3,411Feb 19, 2025Updated last year
- 基于 scrapy-redis 的通用分布式爬虫框架☆613Mar 31, 2023Updated 3 years ago
- 关键词式指定站点新闻爬虫☆17Sep 19, 2020Updated 6 years ago
- ☆34Nov 1, 2024Updated 2 years ago
- 通用新闻类网站分布式爬虫☆79Jul 17, 2018Updated 8 years ago
- 武汉大学2021级网安舆情分析大作业☆11May 25, 2024Updated 2 years ago
- ast基础框架-基于babel☆590Mar 11, 2022Updated 4 years ago
- 爬虫合集☆126Jan 12, 2024Updated 2 years ago
- 新闻爬虫，爬取新浪、搜狐、新华网即时财经新闻。☆200May 9, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 與情分析系统，包括爬虫、数据清洗、文本摘要、主题分类、情感倾向性识别以及分析结果数据可视化☆459Jul 16, 2022Updated 4 years ago
- 逆向☆401Oct 13, 2022Updated 4 years ago
- 腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等☆302Jun 6, 2025Updated last year
- 爬虫管理系统，支持集群，弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本☆133Dec 2, 2024Updated last year
- BlastWithCaptcha v0.2 验证码识别 爆破 本地ocr 多线程爆破 支持带id的验证码 支持payload变形☆60Jul 12, 2022Updated 4 years ago
- 思通舆情 是一款开源免费的舆情系统，支持本地化部署一键安装。支持对海量的舆情数据进行交叉分析和深度挖掘,为用户提供全面的舆情数据,专业的舆情分析，快速的舆情处理等服务,提升企业品牌价值和风控能力。 #舆情系统 #舆情监测 #网络舆情 #开源舆情 #免费舆情 #舆情分析☆315Nov 27, 2025Updated 11 months ago
- 主要用来收集/学习爬虫相关技术如：js逆向、app逆向、抓包、验证码、加密技术、自动化技术、机器学习。☆1,347Aug 20, 2026Updated 2 months ago