facert/scrapy_helper external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

facert/scrapy_helper

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/facert/scrapy_helper)

Close

facert / scrapy_helperView on GitHubMore

• External links
• Readme badge

Dynamic configurable crawl (动态可配置化爬虫)

☆86Jan 13, 2018Updated 8 years ago

Alternatives and similar repositories for scrapy_helper

Users that are interested in scrapy_helper are comparing it to the libraries listed below

• keepljg / flySpider

  View on GitHub
  基于 asyncio,aiohttp,uvloop 的爬虫框架
  ☆13Jul 18, 2018Updated 7 years ago
• JSREI / javascript-window-listener-library

  View on GitHub
  javascript逆向开发基础组件，监听window的变化
  ☆18Feb 11, 2024Updated 2 years ago
• rfyiamcool / jd_product_spider

  View on GitHub
  京东商品爬虫服务
  ☆13Jul 23, 2017Updated 8 years ago
• yjqiang / geetest_test

  View on GitHub
  极验滑动验证码研究报告
  ☆70Jul 29, 2021Updated 4 years ago
• GuoZhaoHui628 / Youtube-Upload-In-Java

  View on GitHub
  使用Java语言自动上传视频到Youtube，并添加缩略图。Upload video of custom the thumbnail to Youtube automatically in java
  ☆14Dec 11, 2020Updated 5 years ago
• jinsecaijing / api_wiki

  View on GitHub
  api wiki
  ☆23Apr 25, 2018Updated 7 years ago
• Karmenzind / WanFangData

  View on GitHub
  spider and a web application for WanFang scholar website 万方数据爬虫+Web展示+TF-IDF相似度分析
  ☆24Mar 22, 2021Updated 4 years ago
• soul-cat / DouYinSign

  View on GitHub
  web版抖音采集的一种解决方案
  ☆19Jul 8, 2020Updated 5 years ago
• cyhleo / DaZongDianPing

  View on GitHub
  爬取大众点评中11205条厦门美食商铺信息，其中包含店名、人均消费、所属菜系、所属商圈、详细地址、口味评分、环境评分、服务评分信息。
  ☆20Apr 21, 2020Updated 5 years ago
• KXCY-AI / MLVP

  View on GitHub
  可视编程机器学习平台 - 『人人可做的机器学习』-《智能数据挖掘》实战系列视频演示实验数据集与数据分析流
  ☆20Mar 13, 2021Updated 4 years ago
• cxapython / discogs_aio_spider

  View on GitHub
  基于httpx的一个大型项目 ，爬取黑胶唱片网站 Discogs
  ☆102Jul 14, 2025Updated 7 months ago
• rangertaha / scrapy-prometheus-exporter

  View on GitHub
  Scrapy stats exporter for prometheus
  ☆22Aug 22, 2025Updated 6 months ago
• chenjiandongx / async-bili-spider

  View on GitHub
  📹 B 站异步爬虫初体验
  ☆25Feb 17, 2019Updated 7 years ago
• pjialin / pyproxy-async

  View on GitHub
  基于 Python Asyncio + Redis 实现的代理池
  ☆170Apr 18, 2024Updated last year
• Python3WebSpider / ScrapyPyppeteerDeprecated

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆24Jul 13, 2018Updated 7 years ago
• xrlin / DoubanPyspider

  View on GitHub
  使用Pyspider框架的豆瓣爬虫
  ☆27Jan 11, 2018Updated 8 years ago
• Boris-code / feaplat

  View on GitHub
  爬虫管理系统，支持集群，弹性伸缩。支持运行feapder、scrapy、selenium、playwright等各种框架及脚本
  ☆132Dec 2, 2024Updated last year
• abo123456789 / leek

  View on GitHub
  Distributed task redisqueue(最简单python分布式函数调度框架)
  ☆65Nov 17, 2025Updated 3 months ago
• ShichaoMa / async-downloader

  View on GitHub
  异步协程下载器
  ☆33Jun 30, 2018Updated 7 years ago
• mdcgqq / MyHooker

  View on GitHub
  搜集平时学习工作中常用的frida脚本
  ☆42Feb 7, 2025Updated last year
• siegfried415 / portia-dashboard

  View on GitHub
  portia-dashboard is a visual web crawler based on scrapinghub/portia
  ☆230Mar 19, 2018Updated 7 years ago
• CodeTeng / personalHealth

  View on GitHub
  一个管理你的个人饮食健康的平台，旨在配合热爱运动和健身的朋友们开发一款能够完成卡路里统计，运动计划编写，科学食物搭配，以及方便与其它朋友交流心得。欢迎大家star！！！
  ☆13Apr 11, 2022Updated 3 years ago
• wangy8961 / python3-concurrency-aqi

  View on GitHub
  并发爬取全国城市空气质量日报数据，数据来源： http://datacenter.mep.gov.cn
  ☆10Sep 1, 2018Updated 7 years ago
• beforeuwait / PSTE

  View on GitHub
  一个api， 提供在线实时查询 被执行人/失信被执行人查询结果
  ☆12Dec 29, 2018Updated 7 years ago
• darkhandz / XPS15-9550-BigSur

  View on GitHub
  DELL XPS15 9550 11.0 黑苹果 配置
  ☆10Dec 11, 2020Updated 5 years ago
• Yixiaohan / Starred-Articles

  View on GitHub
  读书看文章，是个非常个人且主观的事情。这里记录下自己看过得，值得记录下来的文章。
  ☆42Nov 6, 2017Updated 8 years ago
• only2dhir / aes-encryption-javascript-java

  View on GitHub
  In this article we will be creating an application with spring mvc and angular js client. We will have a login page with form inputs for …
  ☆11Jun 20, 2022Updated 3 years ago
• shariqmalik / AdminGrabber

  View on GitHub
  ☆15Nov 23, 2022Updated 3 years ago
• striver-ing / crack_slider

  View on GitHub
  缺口类滑块验证码识别
  ☆35May 29, 2019Updated 6 years ago
• threefish / nutz-sqltpl

  View on GitHub
  nutz中使用xml管理sql模版（默认beetl引擎渲染，可自定义扩展为其他模版引擎）
  ☆10Jan 21, 2022Updated 4 years ago
• karlospn / profiling-net6-api-demo

  View on GitHub
  This repository contains a .NET 6 API that will be used to demonstrate how to do profiling with dotnet-trace, dotnet-dump, dotnet-counter…
  ☆10Mar 3, 2022Updated 4 years ago
• PASSERBY-A / videoperform

  View on GitHub
  处理视频，通过修改视频文件达到变更文件md5，从而使视频变唯一，不在秒传，不在被封杀。
  ☆10Dec 2, 2015Updated 10 years ago
• Tr3jer / AutoHookSpider

  View on GitHub
  将自动爬虫的结果判断是否属于hooks，并不断抓取url爬啊爬。
  ☆30Jun 2, 2017Updated 8 years ago
• lmyyyyyy / chameleon

  View on GitHub
  一种可定制化的网络爬虫(A customizable web crawler)
  ☆10May 14, 2019Updated 6 years ago
• VishalRamki / node-vlive-downloader

  View on GitHub
  A simple robust vlive downloader that collects meta data, subtitles and video streams and merges it into mkv files
  ☆13Jul 12, 2023Updated 2 years ago
• UaHaLiubolun / MusicSpider

  View on GitHub
  网易云音乐爬虫
  ☆10Apr 12, 2017Updated 8 years ago
• zdg39 / Z-Spider

  View on GitHub
  一些爬虫开发的技巧和案例
  ☆39Dec 5, 2023Updated 2 years ago
• xiaoyang611 / crawler-denfender

  View on GitHub
  反网页爬虫系统
  ☆39Mar 10, 2015Updated 10 years ago
• dengqiangxi / zhihu_spider

  View on GitHub
  知乎爬虫，用于爬取用户信息以及用户之间关系。
  ☆33Nov 22, 2022Updated 3 years ago