wycm/crawler-set external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

wycm/crawler-set

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/wycm/crawler-set)

Close

wycm / crawler-setView on GitHubMore

• External links
• Readme badge

各种网站爬虫合集，持续更新中....

☆19Mar 26, 2019Updated 6 years ago

Alternatives and similar repositories for crawler-set

Users that are interested in crawler-set are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• MartinDai / TBSpider

  View on GitHub
  基于Jsoup实现的淘宝爬虫项目
  ☆11Jun 7, 2021Updated 4 years ago
• Aloneyooto / financial-transaction-system

  View on GitHub
  SpringCloud+Vertx+Disruptor金融业撮合交易系统（学习ing）
  ☆11Nov 9, 2020Updated 5 years ago
• yx-Team / cnode

  View on GitHub
  uniapp cnode
  ☆16Dec 10, 2018Updated 7 years ago
• ahuan9527 / xuewuyou

  View on GitHub
  开源项目，供学习
  ☆10May 7, 2021Updated 4 years ago
• EasyKotlin / reakt

  View on GitHub
  ☆16Dec 29, 2017Updated 8 years ago
• xuziping / wx-crawl

  View on GitHub
  微信公众号文章爬虫
  ☆44Sep 1, 2022Updated 3 years ago
• lrjxgl / dt-ui

  View on GitHub
  dt-ui 基于css的手机ui模板库, 适用于wap、小程序、react、vue、uniapp、weex。QQ交流群:277542543 官网：http://ui.deitui.com
  ☆26May 20, 2020Updated 5 years ago
• madpudding / RelationshipCrawler

  View on GitHub
  知网、万方、专利局爬虫
  ☆11Mar 20, 2019Updated 7 years ago
• CrawlScript / WeiboLoginTool

  View on GitHub
  基于WebCollector的新浪微博爬虫及相关登录工具，如新浪微博Cookie获取
  ☆14Nov 21, 2018Updated 7 years ago
• pig-mesh / office2md

  View on GitHub
  [Required for large models] Office to Markdown service implementation, based on Microsoft Markitdown.
  ☆33Apr 10, 2025Updated 11 months ago
• ukong / trade-stock

  View on GitHub
  智牛(trade-stock)金融交易平台是服务于金融衍生产品, 包含外汇, 贵金属, 期货, 股票等. 各产品具有不同属性与交易规则, 本项目对标MT4/MT5等大型交易平台, 遵循FIX全球最广泛的金融市场通用协议. 包含证券用户注册,交易开户, 行情订阅与呈现, 市…
  ☆12Mar 16, 2022Updated 4 years ago
• narutolby / FileSyncForServers

  View on GitHub
  服务器间文件同步
  ☆12Aug 29, 2013Updated 12 years ago
• sdogsq / ctrip-hotel-spider

  View on GitHub
  selenium 携程酒店爬虫+简单数据分析
  ☆10Dec 6, 2018Updated 7 years ago
• WKaKa / Assess

  View on GitHub
  评价功能的实现
  ☆11Oct 14, 2016Updated 9 years ago
• chmod740 / BaiduBaikeSpider

  View on GitHub
  百度百科多线程爬虫Java源码，数据存储采用了Oracle11g
  ☆13Feb 23, 2017Updated 9 years ago
• huanzi-qch / spider

  View on GitHub
  Spider网络爬虫Demo，主要功能有：抓取小说并保存到本地TXT文件；小说线上采集阅读；ip代理池维护，并制作简易流量爬虫；乐心健康步数测试；
  ☆20Aug 1, 2025Updated 7 months ago
• luoyuan800 / Mathematics

  View on GitHub
  数学函数，表达式，公式，坐标，长度，圆，圆弧，方程，计算式的Java语言实现。
  ☆12Dec 28, 2016Updated 9 years ago
• seawaylee / spark-rec-v2

  View on GitHub
  Spark混合推荐系统大数据监控平台
  ☆11May 1, 2018Updated 7 years ago
• HappyWjl / spider-jsoup

  View on GitHub
  基于jsoup的入门爬虫系统，包括接口爬、定时爬、多线程爬
  ☆22Sep 1, 2022Updated 3 years ago
• yijiajia / ReptilianDemo

  View on GitHub
  基于SpringBoot+HtmlClient+Jsoup实现java爬取网易云音乐
  ☆37Sep 1, 2022Updated 3 years ago
• jamiescou / red-envelope

  View on GitHub
  基于mpvue开发微信小程序--包红包（拼图，拼字，语音等）
  ☆10Dec 5, 2018Updated 7 years ago
• sheng-kai-wang / ChatOps4Msa

  View on GitHub
  ChatOps for Microservices Architecture - ChatOps4Msa
  ☆12Aug 28, 2023Updated 2 years ago
• nkynp74dak / wenzi-sc-shipin

  View on GitHub
  文字自动生成视频 - 文字生成视频的AI工具软件汇总
  ☆12Apr 17, 2025Updated 11 months ago
• rkl71 / ai-agent

  View on GitHub
  针对医疗资源分配不均、基础疾病咨询占用专业医生时间等问题，结合国家"互联网+医疗健康"政策导向，开发基于Spring AI框架的智能医疗咨询平台。项目采用RAG检索增强生成技术构建专业医疗知识库，通过MCP协议集成多种外部工具服务，实现具备自主规划能力的AI Agent智能…
  ☆22Jun 20, 2025Updated 9 months ago
• shwen99 / EclipseKey

  View on GitHub
  some shotcut keys add-ins for Visual Studio like Eclipse
  ☆14Mar 25, 2017Updated 8 years ago
• lizhijun / chat-style-ai

  View on GitHub
  一个优雅的工具，让 AI 对话内容更有温度。将 ChatGPT、Claude 等 AI 助手的回复转换成精美的图片。支持将 Markdown 内容转换为精美的小红书风格图片。
  ☆10Feb 1, 2025Updated last year
• mazaisantan / FinacialStatements

  View on GitHub
  从cninfo下载上证、深证的所有上市公司的部分财务指标和数据，根据神奇公式选出30只股票。
  ☆10Aug 5, 2019Updated 6 years ago
• yzcheng90 / ms-ui

  View on GitHub
  ms 前台
  ☆11Oct 29, 2019Updated 6 years ago
• leilayanhui / Magic-Formula-Cn

  View on GitHub
  适用中国市场的神奇公式
  ☆12May 5, 2017Updated 8 years ago
• code4craft / mocksocks

  View on GitHub
  A socks proxy for network monitor.
  ☆12Feb 28, 2014Updated 12 years ago
• princeqjzh / iSelenium

  View on GitHub
  WebUI 自动化测试练习项目
  ☆13Jan 22, 2022Updated 4 years ago
• codingdie / Digger

  View on GitHub
  一个集分布式爬虫,分布式存储,分布式计算统计分析一体的统计分析数据挖掘项目
  ☆14Feb 6, 2018Updated 8 years ago
• Williamsunsir / Spider-taobao

  View on GitHub
  ☆11Mar 1, 2019Updated 7 years ago
• yangwx1402 / wb_wx_zh_tt

  View on GitHub
  新浪微博，微信，知乎，头条爬虫，支持新浪登录打码获取cookie实现登录
  ☆16Jul 3, 2017Updated 8 years ago
• suifeng412 / first-algorithm

  View on GitHub
  66道算法题目+php解题+java解题
  ☆11Sep 12, 2018Updated 7 years ago
• himself65 / website-failure-check-box

  View on GitHub
  Auto check if some website failure. 定时检查网站是否关闭
  ☆12Jan 5, 2023Updated 3 years ago
• kinsleykajiva / Ripple-WebRTC-Server

  View on GitHub
  This is a Java based WebRTC server, using the latest Java tools & API .
  ☆19Mar 22, 2024Updated 2 years ago
• jevy146 / selenium_Alibaba

  View on GitHub
  抓取阿里巴巴国际站并将对应的图片保存到excel中
  ☆13Jun 18, 2020Updated 5 years ago
• jacktop / CryptocurrencyExchangeTechnology

  View on GitHub
  加密货币交易所核心模块的架构设计与技术细节（交易系统、撮合引擎系统、行情系统、做市系统、MPC钱包系统、网络安全基础设施）
  ☆43Feb 6, 2023Updated 3 years ago