laixin86714802/spider-platform external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

laixin86714802/spider-platform

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/laixin86714802/spider-platform)

Close

laixin86714802 / spider-platformView on GitHubMore

• External links
• Readme badge

可视化爬虫自动采集平台

☆186Feb 27, 2023Updated 3 years ago

Alternatives and similar repositories for spider-platform

Users that are interested in spider-platform are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• clovebreath / activiti-editor

  View on GitHub
  工作流编辑器，表单设计器。
  ☆12Dec 25, 2017Updated 8 years ago
• siegfried415 / portia-dashboard

  View on GitHub
  portia-dashboard is a visual web crawler based on scrapinghub/portia
  ☆230Mar 19, 2018Updated 8 years ago
• laomu1024 / spider-website

  View on GitHub
  网站爬虫：根据指定规则下载整个站点
  ☆17Mar 13, 2017Updated 9 years ago
• dengw8 / wxGame-src

  View on GitHub
  微信小程序上面的一些小游戏源码 （from 菜鸟要飞）
  ☆43Jan 6, 2018Updated 8 years ago
• 2young2simple / yispider

  View on GitHub
  一款分布式爬虫平台，帮助你更好的管理和开发爬虫。 内置一套爬虫定义规则（模版），可使用模版快速定义爬虫，也可当作框架手动开发爬虫。(兴趣使然的项目，用的不爽了就更新)
  ☆161Dec 26, 2017Updated 8 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• soul-cat / DouYinSign

  View on GitHub
  web版抖音采集的一种解决方案
  ☆19Jul 8, 2020Updated 5 years ago
• lvmoney / frame

  View on GitHub
  java版微服务常用技术完全整合架构。通过maven添加依赖即用。完全满足开发到发布到k8s的整个devops流程。框架不会有具体的业务实现代码，不过在开发的时候留附带的demo以便校验。框架大部分技术已用到真实业务系统，以确保可行性和正确性。
  ☆10Jul 22, 2023Updated 2 years ago
• dagege1993 / scrapy

  View on GitHub
  1,huaproject算福利吧,爬取的中国校花网,并且保存到本地,基础知识点,url,json,文件的读写. 2,Document.doc 是自己总结的常见爬虫面试题以及答案,但是貌似不想做全职爬虫,所以可能以后也不会更新这一块,爬虫算乐趣, 以后估计重心会放在web …
  ☆14Jan 24, 2018Updated 8 years ago
• kingking888 / CommNewsExtractor

  View on GitHub
  通用文章提取，正文，标题，时间，作者，图片，音视频，联系方式等
  ☆23Mar 19, 2023Updated 3 years ago
• ioiogoo / scrapy-monitor

  View on GitHub
  scrapy-monitor，实现爬虫可视化，监控实时状态
  ☆109Dec 26, 2016Updated 9 years ago
• qiyer / FindNorth

  View on GitHub
  微信小游戏，罗盘转动游戏，egret开发。
  ☆15Nov 1, 2018Updated 7 years ago
• qianqianhaiou / JunkPuppet

  View on GitHub
  拾荒木偶 基于Electron+Puppeteer的可视化爬虫工具，无任何依赖。可视化浏览器自动化任务/采集/无代码/图形化/开源/操作简单/对抗反爬机制
  ☆47Nov 25, 2024Updated last year
• xiaohan008007 / py_echarts

  View on GitHub
  flask项目
  ☆18Dec 8, 2022Updated 3 years ago
• crawlab-team / crawlab-lite

  View on GitHub
  Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台
  ☆230Feb 9, 2023Updated 3 years ago
• Simple, predictable pricing with DigitalOcean hosting • Ad
  Always know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
• codelibs / fione

  View on GitHub
  Fione is Enterprise AI Platform
  ☆16Nov 9, 2025Updated 6 months ago
• CBDxin / chart

  View on GitHub
  基于D3.js + react 实现的数据可视化工具
  ☆13Jan 5, 2023Updated 3 years ago
• fandsimple / chrome_copy

  View on GitHub
  chrome浏览器扩展，复制各大平台文章为本地文章
  ☆26May 1, 2026Updated 3 weeks ago
• mic1on / puppeteer-render

  View on GitHub
  基于puppeteer和NodeJS的服务端渲染，提供Docker一键部署及API调用接口。
  ☆19Aug 30, 2022Updated 3 years ago
• casual-silva / ruishu_untispider

  View on GitHub
  mitproxy 消息拦截 抓取国家药监局等严重瑞数加密相关站点信息
  ☆34Aug 12, 2021Updated 4 years ago
• KitePig / FatRat-Collect

  View on GitHub
  胖鼠采集 WordPress优秀开源采集插件
  ☆516Updated this week
• yimishiji / E-Invoice_v1

  View on GitHub
  基于SASS化的一套多商户线上电子发票系统，支持所有行业的普通增值税发票开具
  ☆22Jan 21, 2021Updated 5 years ago
• langgithub / python_spider

  View on GitHub
  爬虫知识梳理 某宝爬虫 某运营商爬虫 某行征信爬虫 在线爬虫设计 密码控件爬虫 离线爬虫设计
  ☆18Jul 25, 2019Updated 6 years ago
• liangdabiao / simple_ai_toolset

  View on GitHub
  AI大模型的基本开发框架，适合普通后端程序员，功能类似coze包括：fastapi后端接口，搜索，文档解析和向量化，RPA和爬虫，自定义agent，对接第三方数据接口，mongodb数据库，控制json返回，多模态理解和生成等等
  ☆13Jul 18, 2024Updated last year
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• lgbya / vast_pay

  View on GitHub
  Yii2 第四方支付web系统
  ☆10Sep 1, 2021Updated 4 years ago
• crawlab-team / crawlab

  View on GitHub
  Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
  ☆12,199Feb 10, 2026Updated 3 months ago
• zqtz / ecommerce

  View on GitHub
  爬虫电商项目:用scrapy分布式爬虫框架爬取当当商品信息,用selenium模拟登录淘宝和京东收集商品信息
  ☆13Feb 14, 2022Updated 4 years ago
• MonkeyWei06 / falvxinmeiti

  View on GitHub
  - 法旅新媒体开源系统MJ1.0（以下简称MJ软文系统） 熟悉媒介系统手册是使用本程序开发修改的前提，但是还是需要您静下心来好好看看！ - MJ系统是一款专业的软文、稿件（含视频）系统内置集成软文媒体16000 多家，自媒体50000 多家，一键投放平台。该平台采用自助式的…
  ☆15Jan 29, 2021Updated 5 years ago
• kingmo888 / python_Crawler_Tutorial

  View on GitHub
  为《Python3爬虫及可视化数据分析系列图文教程》提供的源码。教程地址：http://www.lizenghai.com/python_pa_chong_jiao_cheng
  ☆16Mar 29, 2019Updated 7 years ago
• highjump0615 / Duck_Backend_Laravel

  View on GitHub
  食品农产品交易小程序的后台admin与API
  ☆14Jan 25, 2018Updated 8 years ago
• linkshark / LinkCloudDisk

  View on GitHub
  基于springcloud开发的分布式美剧订阅系统(含爬虫)
  ☆17Jun 20, 2023Updated 2 years ago
• nlpdz / Design-and-Implementation-of-Multi-source-and-Multi-category-Graphic-Data-Monitoring-Platform

  View on GitHub
  多源多分类图文数据监控平台设计与实现（Python、Django、爬虫、Echarts等技术）
  ☆19Jul 4, 2018Updated 7 years ago
• beforeuwait / HDAVl0l

  View on GitHub
  破解这个视频网站的加密，实现实时采集视频
  ☆23May 5, 2020Updated 6 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• PeterYangs / article-spider

  View on GitHub
  文章采集工具 Article collection tool
  ☆143Sep 8, 2025Updated 8 months ago
• 32167qwj1x / XHS-Spider

  View on GitHub
  颜值超高的数据采集工具
  ☆18May 14, 2023Updated 3 years ago
• boss-mao / scrapy_enterprise_architecture

  View on GitHub
  python scrapy 企业级分布式爬虫开发架构模板
  ☆95Mar 1, 2018Updated 8 years ago
• meilongwhpu / StockRegister

  View on GitHub
  StockRegister是基于FISCO BCOS区块链底层平台研发的股权登记系统，该系统提供了合约治理、账户管理、企业管理、股权管理四大类功能。合约治理主要功能包括创建企业信息合约、创建企业股权合约、创建账户、合约的状态及归属者管理等；账户管理主要功能包括内外部账户映射…
  ☆11Aug 8, 2022Updated 3 years ago
• hengthu / bilibili-video-information-spider

  View on GitHub
  B站视频信息爬虫
  ☆12Apr 19, 2018Updated 8 years ago
• sansanyun / mipjz

  View on GitHub
  thinkphp5
  ☆24Mar 12, 2020Updated 6 years ago
• zkqiang / crawler-chrome-extensions

  View on GitHub
  爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer
  ☆97Jul 27, 2022Updated 3 years ago