striver-ing/distributed-spider external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

striver-ing/distributed-spider

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/striver-ing/distributed-spider)

Close

striver-ing / distributed-spiderView on GitHubMore

• External links
• Readme badge

通用新闻类网站分布式爬虫

☆79Jul 17, 2018Updated 7 years ago

Alternatives and similar repositories for distributed-spider

Users that are interested in distributed-spider are comparing it to the libraries listed below

• striver-ing / internet-content-detection

  View on GitHub
  Python编写的爬虫框架以及特定网站的信息抓取
  ☆18Oct 24, 2017Updated 8 years ago
• CJackHwang / RadioNowhere

  View on GitHub
  多Agent驱动的实时广播电台
  ☆31Feb 8, 2026Updated 3 weeks ago
• icankeep / Document-Storm

  View on GitHub
  实现文档转换的一个网站，目前支持PDF转Word，对Word文档进行翻译等操作，网站还可以获取网易云热门评论等信息
  ☆12Dec 16, 2022Updated 3 years ago
• jfzhang95 / news_spider

  View on GitHub
  新闻爬虫 (腾讯,网易,新浪,今日头条,搜狐,凤凰网,腾讯滚动新闻)
  ☆58Jun 6, 2018Updated 7 years ago
• striver-ing / headlines_today

  View on GitHub
  基于Python的爬取今日头条文章及视频
  ☆35Dec 15, 2016Updated 9 years ago
• Jacen789 / NewsCrawler

  View on GitHub
  新闻爬虫，爬取新浪、搜狐、新华网即时财经新闻。
  ☆191May 9, 2020Updated 5 years ago
• dongrunhua / ScrapyUniversal

  View on GitHub
  基于Scrapy的通用爬虫框架
  ☆25Jan 9, 2019Updated 7 years ago
• striver-ing / wechat-spider

  View on GitHub
  开源微信爬虫：爬取公众号所有 文章、阅读量、点赞量和评论内容。易部署。持续维护！！！
  ☆2,760Mar 31, 2023Updated 2 years ago
• LHJ-8023 / mysql_excel_utils

  View on GitHub
  Java 导出MySQL数据库数据到excel表格和导入excel数据到数据库
  ☆25Dec 18, 2018Updated 7 years ago
• Python3WebSpider / ScrapyUniversal

  View on GitHub
  Scrapy Universal Spider
  ☆56Aug 26, 2017Updated 8 years ago
• MiRaIOMeZaSu / spider_reverse

  View on GitHub
  爬虫逆向学习
  ☆28Aug 14, 2022Updated 3 years ago
• Johnson0722 / News_scrapy_redis

  View on GitHub
  ☆31Jul 5, 2018Updated 7 years ago
• bloossoms / xiecheng_hotel_reviews_spider

  View on GitHub
  基于selenium的携程酒店评论爬取
  ☆12May 10, 2021Updated 4 years ago
• elephantnose / words-mining

  View on GitHub
  新词发现/新词挖掘/自由度/凝固度/python3
  ☆10May 28, 2019Updated 6 years ago
• GeneralNewsExtractor / GneList

  View on GitHub
  A chrome extension to get XPath of list items in webpage easily.
  ☆35Mar 11, 2022Updated 3 years ago
• gsh199449 / DistributeCrawler

  View on GitHub
  基于Map/Reduce爬虫,可抽取各大新闻网站的新闻正文并进行分类和聚类
  ☆74Jan 5, 2014Updated 12 years ago
• LoseUFaith / WOS_crawler

  View on GitHub
  利用 selenium 自动化控制 Chrome 浏览器以 Excel 格式导出 Web of Science 搜索结果
  ☆11Aug 15, 2022Updated 3 years ago
• stonelf / cn_Braille

  View on GitHub
  汉字转换盲文
  ☆14Nov 7, 2022Updated 3 years ago
• nkynp74dak / wenzi-sc-shipin

  View on GitHub
  文字自动生成视频 - 文字生成视频的AI工具软件汇总
  ☆12Apr 17, 2025Updated 10 months ago
• inhai-wiki / SVG-Copilot

  View on GitHub
  This is a lightweight browser extension that allows you to effortlessly convert SVG files to PNG format. The plugin offers real-time prev…
  ☆11Sep 16, 2024Updated last year
• Martin-030621 / TouTiao_Selenium

  View on GitHub
  今日头条搜索引擎以及新闻详情页爬虫（Selenium）
  ☆15Mar 13, 2025Updated 11 months ago
• sdogsq / ctrip-hotel-spider

  View on GitHub
  selenium 携程酒店爬虫+简单数据分析
  ☆10Dec 6, 2018Updated 7 years ago
• wyvern1723 / sachet

  View on GitHub
  Sachet 是一款使用 Flutter 开发的应用，旨在为湘潭大学学生提供轻快流畅的课程表，便捷的空闲教室查询，以及直观全面的成绩信息等核心教务功能以及其他便捷服务 | An app designed for Xiangtan University students, …
  ☆16Feb 13, 2026Updated 3 weeks ago
• LucasDitchun / Prompt-Hub

  View on GitHub
  This repository features a rich collection of optimized prompts for AI applications, focusing on ChatGPT and other conversational agents.…
  ☆12Jan 11, 2025Updated last year
• Gerapy / GerapyAutoExtractor

  View on GitHub
  Auto Extractor Module
  ☆334Aug 19, 2024Updated last year
• casual-silva / NewsCrawl

  View on GitHub
  狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑
  ☆662Jan 12, 2024Updated 2 years ago
• LiuXingMing / Scrapy_Redis_Bloomfilter

  View on GitHub
  基于Redis的Bloomfilter去重，并将其扩展到Scrapy框架。
  ☆346Feb 26, 2023Updated 3 years ago
• arsham / fzfmania.nvim

  View on GitHub
  Powerful FZF setup for Neovim in Lua
  ☆12Oct 28, 2023Updated 2 years ago
• FashtimeDotCom / agrProduct

  View on GitHub
  爬取农业信息网全国农产品数据的简单爬虫
  ☆15Dec 18, 2016Updated 9 years ago
• rdcprojects / scrapy-mq-redis

  View on GitHub
  A RabbitMQ/Redis tool for Scrapy
  ☆13Oct 7, 2016Updated 9 years ago
• xieh97 / dcase2023-audio-retrieval

  View on GitHub
  Baseline system for Language-based Audio Retrieval (Task 6B) in DCASE 2023 Challenge
  ☆10Aug 8, 2023Updated 2 years ago
• rebase-network / event-pool

  View on GitHub
  Events suitable for Rebase community members to participate.
  ☆11Jun 3, 2025Updated 9 months ago
• James-Cherished-Inc / roo-research-mode

  View on GitHub
  ☆12Jan 20, 2026Updated last month
• Gaoshiguo / python-spider-wiki

  View on GitHub
  这个项目使用python来实现爬取维基百科的关键词条以及其超链接，并写入MySQL数据库中
  ☆11Aug 18, 2020Updated 5 years ago
• LucasIcarus / huxpro.github.io

  View on GitHub
  Huxpro Blog Theme: React.js and Sever Side Rendering Port
  ☆10Sep 18, 2016Updated 9 years ago
• hawkhu / openlayers-official-demo

  View on GitHub
  openlayers official demo hosted on codepen.io.This is a content.
  ☆11Sep 27, 2019Updated 6 years ago
• chawyehsu / wende

  View on GitHub
  🍎Wende Chinese QA system (experimental)
  ☆10Jun 1, 2021Updated 4 years ago
• kingname / SifouSource

  View on GitHub
  Python 业务开发常见错误案例集 配套源代码
  ☆10Dec 19, 2020Updated 5 years ago
• cxapython / Spider

  View on GitHub
  爬虫， 反爬虫， JS 逆向， 安卓逆向， AST
  ☆12Sep 14, 2020Updated 5 years ago