digfound/sinacrawler external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

digfound/sinacrawler

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/digfound/sinacrawler)

Close

digfound / sinacrawlerView on GitHubMore

• External links
• Readme badge

第一次编写Python网络爬虫，主要使用beautifulsoup4爬取新浪新闻首页新闻列表。成功获取新闻标题、时间、来源、详情、评论数、编辑信息，使用pandas整理数据，并保存到数据库。

☆13Dec 7, 2017Updated 8 years ago

Alternatives and similar repositories for sinacrawler

Users that are interested in sinacrawler are comparing it to the libraries listed below

• Sen-Yao / RCS-Calculator

  View on GitHub
  A python script to calculate radar cross section.
  ☆11Dec 26, 2023Updated 2 years ago
• Martin-030621 / TouTiao_Selenium

  View on GitHub
  今日头条搜索引擎以及新闻详情页爬虫（Selenium）
  ☆15Mar 13, 2025Updated 11 months ago
• q429 / spider

  View on GitHub
  招聘网站爬虫：1.使用Python爬取智联招聘等网站。2.使用XPath、BeautifulSoup等包解析网页。3.保存到MongoDB数据库中。
  ☆16Oct 30, 2019Updated 6 years ago
• wym819819 / CourseKG

  View on GitHub
  使用大模型自动构建课程知识图谱
  ☆10Aug 9, 2024Updated last year
• allenai / beacon

  View on GitHub
  On-the-fly Definition Augmentation of LLMs for Biomedical NER
  ☆14Apr 14, 2025Updated 10 months ago
• crystal-tensor / spide

  View on GitHub
  网络爬虫 主要抓取的是股票数据，外汇数据，股票背景资料，股票及时新闻
  ☆12Aug 13, 2018Updated 7 years ago
• orangeMask / spider

  View on GitHub
  抖音,淘宝系,常见新闻爬虫
  ☆13Apr 15, 2022Updated 3 years ago
• jiangyuanyuan / lotterySpider

  View on GitHub
  Based on the Scrapy framework, crawling crawlers ------------------ 基于Scrapy 框架开发 抓取新闻的爬虫 -------------
  ☆13Jul 26, 2019Updated 6 years ago
• Ingram7 / NewsinaSpider

  View on GitHub
  Scrapy 新浪新闻爬虫
  ☆12Aug 26, 2019Updated 6 years ago
• haibin-chen / blockchain_crawler

  View on GitHub
  blockchain news crawler 金融新闻爬虫+自然语言处理分析
  ☆14Mar 5, 2019Updated 6 years ago
• goozp / ths-spider-example

  View on GitHub
  完整的 scrapy 爬虫示例，爬取股票和新闻数据
  ☆13Aug 15, 2020Updated 5 years ago
• lxf44944 / sinaNews_crawler

  View on GitHub
  新浪新闻爬虫
  ☆15Feb 14, 2015Updated 11 years ago
• Harhao / toutiao

  View on GitHub
  今日头条科技新闻接口爬虫
  ☆17Sep 26, 2017Updated 8 years ago
• imondo / news-crawler

  View on GitHub
  node 小爬虫，爬取本地新闻
  ☆16May 2, 2024Updated last year
• FrankXiong / cqunews-web

  View on GitHub
  利用Java网络爬虫爬取重庆大学新闻网站数据，依据解析的数据构建的新闻网站
  ☆11Mar 7, 2016Updated 9 years ago
• HZhertz / Python-TTnews

  View on GitHub
  python爬虫文件，爬取今日头条新闻信息并存储到mongoDB数据库，用于TT-news项目添加新闻数据
  ☆12May 20, 2024Updated last year
• vectorsss / news_classification

  View on GitHub
  卷积神经网络&&爬虫 实现网易新闻自动爬取并分类
  ☆13Dec 8, 2022Updated 3 years ago
• pyorc / pyorcnews

  View on GitHub
  基于scrapy框架的新闻爬虫
  ☆11Jan 13, 2016Updated 10 years ago
• rama291041610 / TongHuaShun-Spider

  View on GitHub
  一个同花顺财经新闻的爬虫。
  ☆15Apr 12, 2019Updated 6 years ago
• tfbabi / daxiao_admin

  View on GitHub
  大校财经系统,一个财经爱好者开发的股票相关新闻、大v文章、评论、每日市场情况，选股器等功能的聚合网站。 能够网罗当下财经世界各网站最热门最及时的股票、板块、7x24新闻、技术牛人文章评论，热门题材选股等常用功能。 本网站免费对外开发，基于python+django+vue开…
  ☆20May 20, 2025Updated 9 months ago
• zyc1gq / DBSCAN_NEWS

  View on GitHub
  爬虫爬取网站新闻，DBCAN聚类,推荐系统......
  ☆15May 22, 2018Updated 7 years ago
• woshihuangshuai / YahooFinanceNewsSpider

  View on GitHub
  雅虎财经新闻数据爬虫/Crawler for news on Yahoo! Finance.
  ☆15Jul 18, 2017Updated 8 years ago
• go-predator / predator

  View on GitHub
  High-performance crawler framework based on fasthttp.
  ☆15Aug 15, 2023Updated 2 years ago
• zhr5 / GoBang

  View on GitHub
  JAVA五子棋
  ☆17Jan 8, 2018Updated 8 years ago
• LQ6H / Python_spider

  View on GitHub
  python spider projects practice
  ☆19Jun 6, 2020Updated 5 years ago
• sph116 / zhongxin_search

  View on GitHub
  中国新闻网爬虫（全站增量爬虫，可用时间至2019.7）
  ☆16Jul 13, 2019Updated 6 years ago
• hilanmiao / hexo-theme-lanmiao

  View on GitHub
  使用bootstrap构建的类单页博客，粉色系简洁Hexo主题
  ☆18Apr 27, 2017Updated 8 years ago
• chinwuDebug / CNKI-Sogou_Wechat-Sogou_News-Spider

  View on GitHub
  知网、搜狗微信、搜狗新闻的爬虫
  ☆15Sep 1, 2018Updated 7 years ago
• langgithub / yuqing_system

  View on GitHub
  线下爬虫设计 舆情新闻系统 LDA主题分类 关键字提取 实现一个文本分类器
  ☆15Aug 10, 2019Updated 6 years ago
• x-bessie / AggregationNews

  View on GitHub
  JavaEE实现分布式爬虫新闻聚合网站 SSM框架实现
  ☆18Dec 15, 2022Updated 3 years ago
• luzy99 / news-spider

  View on GitHub
  关键词式指定站点新闻爬虫
  ☆17Sep 19, 2020Updated 5 years ago
• wangjianlin1985 / 1421_Python_NewsSpider_Analysis

  View on GitHub
  1421基于python网易新闻scrapy爬虫数据分析与可视化大屏展示-毕业源码案例设计
  ☆20Apr 3, 2024Updated last year
• JetFeng / SohuSpider-Java

  View on GitHub
  用java写的搜狐新闻爬虫
  ☆14May 2, 2017Updated 8 years ago
• yjysanshu / springboot-authority

  View on GitHub
  权限管理系统后端代码
  ☆21Aug 26, 2024Updated last year
• EnterpriseSolution / Visual-Studio-Downloader

  View on GitHub
  Visual Studio Downloader
  ☆24Jun 27, 2023Updated 2 years ago
• peopleindreamdontsleep / SparkanSpider

  View on GitHub
  java爬虫，反爬虫策略、ETL清洗数据，以及spark离线和实时分析新闻并存入ES
  ☆20Nov 26, 2018Updated 7 years ago
• kongliang2015 / YahooNews_Classification

  View on GitHub
  利用python爬虫从日本雅虎网站获取新闻（政治，经济，体育等类别），对新闻文本做相似度计算，训练新闻分类模型
  ☆19Nov 14, 2017Updated 8 years ago
• LogicJake / tianchi_nlp

  View on GitHub
  天池零基础入门NLP - 新闻文本分类
  ☆19Aug 16, 2020Updated 5 years ago
• Emma1066 / Retrieval-Augmented-IT-OpenNER

  View on GitHub
  The github repository for the paper at COLING 2025: Retrieval Augmented Instruction Tuning for Open NER with Large Language Models.
  ☆26Jun 26, 2024Updated last year