Alternatives and similar repositories for AwesomeWebScraping

Users that are interested in AwesomeWebScraping are comparing it to the libraries listed below

• luzihang123 / scrapyd_pyppeteer

  View on GitHub
  可以用于scrapydweb的scrapyd节点，使用pyppeteer，在scrapy中异步使用
  ☆12Dec 8, 2022Updated 3 years ago
• MuggleK / Decrypt_JS

  View on GitHub
  包含一些网站的登陆参数的解密和部分网址的参数解密，并结合Node.JS和Python进行破解。
  ☆18Sep 3, 2021Updated 4 years ago
• Python3WebSpider / ScrapyPyppeteer

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆12Jul 30, 2020Updated 5 years ago
• yint-tech / malenia-open

  View on GitHub
  malenia是一个对代理IP池进行二次组合的工具，用户可以将多个采购的IP资源进行二次组合，使用统一的账户密码，服务器端口等信息进行统一访问。
  ☆13Jan 2, 2026Updated last month
• Germey / Blog

  View on GitHub
  My Personal Blog
  ☆13Updated this week
• Sruiis / fix_broswer_enviroment_frame

  View on GitHub
  自用补环境框架
  ☆21Jun 23, 2023Updated 2 years ago
• Gerapy / GerapyPlaywright

  View on GitHub
  Downloader Middleware to support Playwright in Scrapy & Gerapy
  ☆111Mar 6, 2022Updated 3 years ago
• lorien / awesome-web-scraping

  View on GitHub
  List of libraries, tools and APIs for web scraping and data processing.
  ☆7,764Jan 13, 2026Updated last month
• kingname / SifouSource

  View on GitHub
  Python 业务开发常见错误案例集 配套源代码
  ☆10Dec 19, 2020Updated 5 years ago
• zhulik / aiosyncthing

  View on GitHub
  Asynchronous Python client for the Syncthing REST API
  ☆10Jan 19, 2026Updated 3 weeks ago
• asyncins / spiderbook

  View on GitHub
  《Python3 网络爬虫宝典》随书配套代码
  ☆21Aug 29, 2020Updated 5 years ago
• downdawn / JSreverse

  View on GitHub
  js逆向和爬虫
  ☆329Jan 12, 2023Updated 3 years ago
• Gerapy / Gerapy

  View on GitHub
  Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
  ☆3,500Oct 29, 2024Updated last year
• Germey / ScrapyTutorial

  View on GitHub
  Scrapy Tutorial
  ☆11Feb 19, 2017Updated 8 years ago
• qqizai / CrackJs

  View on GitHub
  记录一下js逆向的网站
  ☆232May 22, 2023Updated 2 years ago
• sml2h3 / ast_tools

  View on GitHub
  ast基础框架-基于babel
  ☆597Mar 11, 2022Updated 3 years ago
• BestToYou / bestV8_release

  View on GitHub
  一个可以跑js的逆向工具。
  ☆580Jun 28, 2023Updated 2 years ago
• Python3WebSpider / Scrape

  View on GitHub
  Platform of Web Views to Scrape
  ☆11Jun 7, 2020Updated 5 years ago
• spring-raining / CSSLive2D

  View on GitHub
  Rendering Live2D with HTML/CSS!
  ☆33Jul 31, 2024Updated last year
• meimz / wxhook

  View on GitHub
  ☆12Sep 11, 2019Updated 6 years ago
• synodriver / awsome_scrapy_utils

  View on GitHub
  awsome scrapy utils
  ☆57Jan 17, 2026Updated 3 weeks ago
• wqhadija / online-marketer-chatgpt-prompts

  View on GitHub
  A skilled online business marketer utilizing ChatGPT technology to engage with potential customers and effectively pitch products or serv…
  ☆13Oct 3, 2023Updated 2 years ago
• crawlaio / scrapy-redis-sentinel

  View on GitHub
  scrapy-redis-sentinel 基于 scrapy-redis 的基础上 新增 哨兵（sentinel）连接模式 以及 集群（cluster）连接模式。
  ☆30Mar 31, 2023Updated 2 years ago
• bnmgh1 / NodeSandbox

  View on GitHub
  Node补环境框架
  ☆445Jan 28, 2025Updated last year
• my8100 / logparser

  View on GitHub
  A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
  ☆93Jan 5, 2025Updated last year
• frywang / DataMining

  View on GitHub
  对dbpedia和百科采集而来的语料进行清洗，得到合适的三元组
  ☆15Jun 24, 2017Updated 8 years ago
• chencchen / webcrawler

  View on GitHub
  逆向
  ☆404Oct 13, 2022Updated 3 years ago
• Boris-code / feapder_project

  View on GitHub
  使用feapder爬虫框架开发的爬虫示例
  ☆32Dec 3, 2022Updated 3 years ago
• fanchangrui / catvm

  View on GitHub
  js逆向环境框架基础（持续补充）
  ☆247Sep 5, 2022Updated 3 years ago
• bnmgh1 / node-sandbox

  View on GitHub
  魔改Node补环境框架
  ☆238Sep 2, 2023Updated 2 years ago
• yint-tech / sekiro-open

  View on GitHub
  SEKIRO is a multi-language, distributed, network topology-independent service publishing platform. By writing handlers in their respectiv…
  ☆1,890Jan 22, 2026Updated 3 weeks ago
• zkqiang / crawler-chrome-extensions

  View on GitHub
  爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer
  ☆96Jul 27, 2022Updated 3 years ago
• freeFV / fridaUiTools

  View on GitHub
  frida工具的缝合怪
  ☆10Jun 25, 2021Updated 4 years ago
• codemation / easyschedule

  View on GitHub
  Easily schedule single or recurring sync/async tasks
  ☆16Apr 28, 2021Updated 4 years ago
• Germey / JMeterMonitor

  View on GitHub
  JMeter Tester with Influxdb and Grafana
  ☆14Apr 10, 2020Updated 5 years ago
• sdfwesfe / -

  View on GitHub
  利用js算法自动hook前端加密方法，在控制台自动调试吐出加密方法🐂🐂
  ☆42Oct 19, 2025Updated 3 months ago
• rrrrat / PassCaptcha

  View on GitHub
  帮助爬虫通过点选验证及滑动验证, 验证码识别
  ☆99Sep 14, 2022Updated 3 years ago
• lumina37 / rotate-captcha-crack

  View on GitHub
  基于CNN的旋转验证码解决方案✨Predict the rotation angle of given captcha picture through CNN
  ☆469Jan 17, 2026Updated 3 weeks ago
• JSREI / ast-hook-for-js-RE

  View on GitHub
  浏览器内存漫游解决方案（探索中...）
  ☆1,902May 7, 2024Updated last year