澎湃新闻，新浪新闻，腾讯新闻，搜狐新闻，新闻联播，泰晤士报，纽约时报，BBCNews，旨在爬取所有新闻门户网站的新闻，禁止将所得数据商用！
☆453Oct 18, 2022Updated 3 years ago
Alternatives and similar repositories for AllNewsSpider
Users that are interested in AllNewsSpider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 爬取今日头条，网易，腾讯等新闻,并建立简单的搜索引擎☆638May 14, 2024Updated 2 years ago
- 新闻爬虫☆28Aug 14, 2021Updated 4 years ago
- 微博爬虫及配套工具箱，微博用户 、话题、评论采集一网打尽。图片下载、情感分析，地理位置、关系网络、spammer 机器人识别等功能应有尽有。Docs：https://buyixiao.github.io/blog/weibo-super-spider.html 配套可视化网站…☆1,692May 28, 2026Updated last week
- 新闻爬虫，爬取新浪、搜狐、新华网即时财经新闻。☆194May 9, 2020Updated 6 years ago
- 狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑 an enterprise-grade public opinion news …☆675May 23, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- news spider wrote by scrapy ,now it can crawl the news in sina ,and continue to update it.这个是多新闻的增量爬虫版本，爬取腾讯，网易，搜狐的每日新闻 scrapy 实现的版本☆12Oct 14, 2019Updated 6 years ago
- 观察者新闻网爬虫（新闻爬虫），基于python+Flask+Echarts，实现首页与更多新闻页面爬取（Requests+etree+Xpath）+新闻存储(MySQL)+文本分析(Jieba)+可视化(新闻词云，词频统计）。☆101Oct 28, 2021Updated 4 years ago
- FinnewsHunter: Multi-agent financial intelligence platform powered by AgenticX. Real-time news analysis, sentiment fusion, and alpha fact…☆1,434Jan 13, 2026Updated 4 months ago
- 该项目是基于Scrapy框架的Python新闻爬虫，能够爬取网易，搜狐，凤凰和澎湃网站上的新闻，将标题，内容，评论，时间等内容整理并保存到本地☆39Aug 6, 2019Updated 6 years ago
- Python网络爬虫与推荐算法新闻推荐平台：网络爬虫：通过Python实现新浪新闻的爬取，可爬取新闻页面上的标题、文本、图片、视频链接（保留排版） 推荐算法：权重衰减+标签推荐+区域推荐+热点推荐☆122May 22, 2021Updated 5 years ago
- 借助Python抓取微博数据，并对抓取的数据进行情绪分析☆374Mar 31, 2023Updated 3 years ago
- 获取微博搜索结果信息，搜索即可以是微博关键词搜索，也可以是微博话题搜索☆2,300May 13, 2025Updated last year
- 與情分析系统，包括爬虫、数据清洗、文本摘要、主题分类、情感倾向性识别以及分析结果数据可视化☆459Jul 16, 2022Updated 3 years ago
- 获取滚动新闻☆59Nov 19, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 持续维护的新浪微博采集工具🚀🚀🚀☆4,079Aug 23, 2025Updated 9 months ago
- 基于用户行为（关键词和查看过的新闻）的个性化新闻推荐系统☆42Jul 2, 2018Updated 7 years ago
- python爬虫，目前库存：网易云音乐歌曲爬取，B站视频爬取，知乎问答爬取，壁纸爬取，xvideos视频爬取，有声书爬取，微博爬虫，安居客信息爬取+数据可视化，哔哩哔哩视频封面提取器，ip代理池封装，知乎百万级用户爬虫+数据分析，github用户爬虫☆1,620Apr 23, 2024Updated 2 years ago
- 通用 文章提取，正文，标题，时间，作者，图片，音视频，联系方式等☆23Mar 19, 2023Updated 3 years ago
- 人民日报爬虫（Python）☆159Jul 14, 2025Updated 10 months ago
- 微信公众号文章的爬虫☆3,446Apr 18, 2024Updated 2 years ago
- Tracking the hot Github repos and update daily 每天自动追踪Github热门项目☆51Jun 1, 2026Updated last week
- Weibo-COV: A Large-Scale COVID-19 Social Media Dataset from Weibo☆622Aug 23, 2025Updated 9 months ago
- 爬取智联招聘网数据，并对其进行招聘数据可视化，爬虫，Data visualization，Django2，echarts☆136Sep 19, 2023Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 新浪微博爬虫，用python爬取新浪微博数据☆9,611Feb 4, 2026Updated 4 months ago
- ☆18May 11, 2021Updated 5 years ago
- 数据接口：百度、谷歌、头条、微博指数,宏观数据，利率数据，货币汇率，千里马、独角兽公司，新闻联播文字稿，影视票房数据，高校名单，疫情数据…☆2,555Sep 15, 2023Updated 2 years ago
- 爬取雪球网股票评论☆19Apr 28, 2025Updated last year
- 一个新闻政策类爬虫项目，实现上万网站的实时监控、爬取、过滤、存储，具有高可用性和可扩展性。☆41Oct 12, 2022Updated 3 years ago
- 实战🐍多种网站、电商数据爬虫🕷。包含🕸：淘宝商品、微信公众号、大众点评、企查查、招聘网站、闲鱼、阿里任务、博客园、微博、百度贴吧、豆瓣电影、包图网、全景网、豆瓣音乐、某省药监局、搜狐新闻、机器学习文本采集、fofa资产采集、汽车之家、国家统计局、百度关键词收录数、蜘蛛…☆5,549May 22, 2024Updated 2 years ago
- Record my experiments with Biterm Topic Model (BTM). Folk and modify from https://github.com/xiaohuiyan/BTM☆19May 29, 2017Updated 9 years ago
- Text-To-Speech for NotebookLM☆39Jul 20, 2025Updated 10 months ago
- 🇺🇦 Open Source Ukrainian Text-to-Speech datasets☆29Feb 24, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- CnkiSpider is a package for efficiently crawling articles on CNKI☆24Feb 20, 2023Updated 3 years ago
- 长行的爬虫集合：微博、Twitter、玩加、知网、虎牙、斗鱼、B站、WeGame、猫眼、豆瓣、安居客、居理新房☆374Jun 5, 2021Updated 5 years ago
- magicspeech competition recipe☆18Jun 29, 2020Updated 5 years ago
- The 2017 Workshop of Computational Communication Research☆10Sep 23, 2017Updated 8 years ago
- 爬取几大新闻网站新闻及评论☆13Dec 26, 2018Updated 7 years ago
- 本程序支持关键词搜索、热榜、用户信息、回答、专栏文章、评论等信息的抓取☆29Oct 13, 2022Updated 3 years ago
- 关键词式指定站点新闻爬虫☆17Sep 19, 2020Updated 5 years ago