F-debug/NewsSpider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

F-debug/NewsSpider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/F-debug/NewsSpider)

Close

F-debug / NewsSpiderView on GitHubMore

• External links
• Readme badge

该项目是基于Scrapy框架的Python新闻爬虫，能够爬取网易，搜狐，凤凰和澎湃网站上的新闻，将标题，内容，评论，时间等内容整理并保存到本地

☆40Aug 6, 2019Updated 6 years ago

Alternatives and similar repositories for NewsSpider

Users that are interested in NewsSpider are comparing it to the libraries listed below

• sph116 / zhongxin_search

  View on GitHub
  中国新闻网爬虫（全站增量爬虫，可用时间至2019.7）
  ☆16Jul 13, 2019Updated 6 years ago
• jasonren0403 / news_hotspot_crawler

  View on GitHub
  基于scrapy的中国国内各大新闻网站内容爬虫
  ☆27Feb 12, 2022Updated 4 years ago
• 15920036578 / Suning_Spider

  View on GitHub
  苏宁爬虫（大量注释，对刚入门爬虫者极度友好）
  ☆12Apr 7, 2019Updated 6 years ago
• langgithub / yuqing_system

  View on GitHub
  线下爬虫设计 舆情新闻系统 LDA主题分类 关键字提取 实现一个文本分类器
  ☆15Aug 10, 2019Updated 6 years ago
• zyc1gq / DBSCAN_NEWS

  View on GitHub
  爬虫爬取网站新闻，DBCAN聚类,推荐系统......
  ☆15May 22, 2018Updated 7 years ago
• chinwuDebug / CNKI-Sogou_Wechat-Sogou_News-Spider

  View on GitHub
  知网、搜狗微信、搜狗新闻的爬虫
  ☆15Sep 1, 2018Updated 7 years ago
• Ingram7 / NewsinaSpider

  View on GitHub
  Scrapy 新浪新闻爬虫
  ☆12Aug 26, 2019Updated 6 years ago
• kongliang2015 / YahooNews_Classification

  View on GitHub
  利用python爬虫从日本雅虎网站获取新闻（政治，经济，体育等类别），对新闻文本做相似度计算，训练新闻分类模型
  ☆19Nov 14, 2017Updated 8 years ago
• frankness / kb_qa

  View on GitHub
  时序的金融领域知识图谱构建及问答 以年报为数据 jena为框架
  ☆11Aug 16, 2018Updated 7 years ago
• woshihuangshuai / YahooFinanceNewsSpider

  View on GitHub
  雅虎财经新闻数据爬虫/Crawler for news on Yahoo! Finance.
  ☆15Jul 18, 2017Updated 8 years ago
• realzhengyiming / newsSpier_scrapy

  View on GitHub
  news spider wrote by scrapy ,now it can crawl the news in sina ,and continue to update it.这个是多新闻的增量爬虫版本，爬取腾讯，网易，搜狐的每日新闻 scrapy 实现的版本
  ☆12Oct 14, 2019Updated 6 years ago
• Heisenberg0391 / NewsSpider

  View on GitHub
  爬取几大新闻网站新闻及评论
  ☆13Dec 26, 2018Updated 7 years ago
• wangy8961 / python3-concurrency-aqi

  View on GitHub
  并发爬取全国城市空气质量日报数据，数据来源： http://datacenter.mep.gov.cn
  ☆10Sep 1, 2018Updated 7 years ago
• xiaoxiong74 / Spiders

  View on GitHub
  微博关键词搜索爬虫、微博爬虫、链家房产爬虫、新浪新闻爬虫、腾讯招聘爬虫、招投标爬虫
  ☆38Feb 2, 2019Updated 7 years ago
• cyhleo / JinRiTouTiaoNews

  View on GitHub
  scrapy+pyppeteer，爬取今日头条中新闻及热门评论信息。
  ☆12May 6, 2020Updated 5 years ago
• lowesyang / Lowes-News

  View on GitHub
  新闻聚合+新闻推荐网站
  ☆10Jun 21, 2017Updated 8 years ago
• hahaha108 / MyNews

  View on GitHub
  基于scrapy-redis的分布式新闻爬虫，可同时获取腾讯、网易、搜狐、凤凰网、新浪、东方财富、人民网等各大平台新闻资讯
  ☆47Apr 21, 2018Updated 7 years ago
• orangeMask / spider

  View on GitHub
  抖音,淘宝系,常见新闻爬虫
  ☆13Apr 15, 2022Updated 3 years ago
• uimeis / python-spider-cookbook-www.meishij.net

  View on GitHub
  python爬虫实战，4.6w个美食杰菜谱，使用多进程，数据保存到MongoDB，最后挑选网友最喜欢的菜谱。
  ☆12Mar 5, 2018Updated 8 years ago
• crystal-tensor / spide

  View on GitHub
  网络爬虫 主要抓取的是股票数据，外汇数据，股票背景资料，股票及时新闻
  ☆12Aug 13, 2018Updated 7 years ago
• logikoisto / Mit6824

  View on GitHub
  完成 mit 6824 lab
  ☆11Jul 9, 2020Updated 5 years ago
• rio26 / weibo-comments-word-cloud

  View on GitHub
  微博评论爬虫+评论html tag清洗+中文词云生成
  ☆31Jul 2, 2018Updated 7 years ago
• jfzhang95 / news_spider

  View on GitHub
  新闻爬虫 (腾讯,网易,新浪,今日头条,搜狐,凤凰网,腾讯滚动新闻)
  ☆58Jun 6, 2018Updated 7 years ago
• tankle / newscrawler

  View on GitHub
  新闻网站爬虫,目前能够爬取网易，新浪，qq，搜狐等三家网站的新闻页面，并保存到本地。
  ☆34Jun 12, 2015Updated 10 years ago
• goozp / ths-spider-example

  View on GitHub
  完整的 scrapy 爬虫示例，爬取股票和新闻数据
  ☆14Aug 15, 2020Updated 5 years ago
• imondo / news-crawler

  View on GitHub
  node 小爬虫，爬取本地新闻
  ☆16May 2, 2024Updated last year
• Freakwill / gimbiseo

  View on GitHub
  🤖Man-machine conversation system base on owlready2, inspirited by an Korean TV play (基于 owlready2 的问答系统。灵感来自韩剧《金秘书你为何这样》)
  ☆13Apr 22, 2020Updated 5 years ago
• jifan-chen / Fact-checking-via-Raw-Evidence

  View on GitHub
  Code for the arxiv paper: Complex Claim Verification with Evidence Retrieved in the Wild
  ☆13Nov 27, 2023Updated 2 years ago
• pyorc / pyorcnews

  View on GitHub
  基于scrapy框架的新闻爬虫
  ☆11Jan 13, 2016Updated 10 years ago
• Chankeitin / SpringBoot-property

  View on GitHub
  物业管理APP，前后端分离，基于vue2，uniapp，vue-cli，springboot，springsecurity，mybatisplus，mysql初步实现物业管理APP前端界面，后台管理界面，后台系统
  ☆12Jun 22, 2021Updated 4 years ago
• FrankXiong / cqunews-web

  View on GitHub
  利用Java网络爬虫爬取重庆大学新闻网站数据，依据解析的数据构建的新闻网站
  ☆11Mar 7, 2016Updated 10 years ago
• haibin-chen / blockchain_crawler

  View on GitHub
  blockchain news crawler 金融新闻爬虫+自然语言处理分析
  ☆14Mar 5, 2019Updated 7 years ago
• vectorsss / news_classification

  View on GitHub
  卷积神经网络&&爬虫 实现网易新闻自动爬取并分类
  ☆13Dec 8, 2022Updated 3 years ago
• HZhertz / Python-TTnews

  View on GitHub
  python爬虫文件，爬取今日头条新闻信息并存储到mongoDB数据库，用于TT-news项目添加新闻数据
  ☆11May 20, 2024Updated last year
• fengtao256 / gxaes

  View on GitHub
  在线考试系统
  ☆12Apr 28, 2020Updated 5 years ago
• bytebuff / androidSpider

  View on GitHub
  Android逆向爬虫
  ☆13Oct 26, 2019Updated 6 years ago
• GAIR-NLP / Safety-J

  View on GitHub
  Safety-J: Evaluating Safety with Critique
  ☆16Jul 28, 2024Updated last year
• yev / java-ffmpeg-pipe

  View on GitHub
  Simple yet powerful example of integration ffmpeg with java
  ☆12Apr 23, 2014Updated 11 years ago
• lxf44944 / sinaNews_crawler

  View on GitHub
  新浪新闻爬虫
  ☆15Feb 14, 2015Updated 11 years ago