clemfromspace/scrapy-puppeteer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

clemfromspace/scrapy-puppeteer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/clemfromspace/scrapy-puppeteer)

Close

clemfromspace / scrapy-puppeteerView on GitHubMore

• External links
• Readme badge

Scrapy + Puppeteer

☆110Jun 11, 2021Updated 4 years ago

Alternatives and similar repositories for scrapy-puppeteer

Users that are interested in scrapy-puppeteer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• elacuesta / scrapy-pyppeteer

  View on GitHub
  Pyppeteer integration for Scrapy
  ☆58Feb 26, 2021Updated 5 years ago
• lopuhin / scrapy-pyppeteer

  View on GitHub
  Use pyppeteer from a Scrapy spider
  ☆59Feb 5, 2020Updated 6 years ago
• ispras / scrapy-puppeteer

  View on GitHub
  Library that helps use puppeteer in scrapy.
  ☆51Aug 1, 2025Updated 7 months ago
• clemfromspace / scrapy-selenium

  View on GitHub
  Scrapy middleware to handle javascript pages using selenium
  ☆958Jul 8, 2024Updated last year
• Gerapy / GerapyPyppeteer

  View on GitHub
  Downloader Middleware to support Pyppeteer in Scrapy & Gerapy
  ☆136Dec 27, 2021Updated 4 years ago
• 1-Click AI Models by DigitalOcean Gradient • Ad
  Deploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
• Python3WebSpider / ScrapyPyppeteerDeprecated

  View on GitHub
  Scrapy Pyppeteer Demo
  ☆24Jul 13, 2018Updated 7 years ago
• colmex / frontera_example

  View on GitHub
  Example frontera project
  ☆12Aug 10, 2017Updated 8 years ago
• Germey / JMeterMonitor

  View on GitHub
  JMeter Tester with Influxdb and Grafana
  ☆14Apr 10, 2020Updated 5 years ago
• Germey / Blog

  View on GitHub
  My Personal Blog
  ☆13Mar 8, 2026Updated 3 weeks ago
• luzihang123 / scrapyd_pyppeteer

  View on GitHub
  可以用于scrapydweb的scrapyd节点，使用pyppeteer，在scrapy中异步使用
  ☆12Dec 8, 2022Updated 3 years ago
• scrapinghub / spidermon

  View on GitHub
  Scrapy Extension for monitoring spiders execution.
  ☆552Mar 20, 2026Updated last week
• dhepper / django-model-path-converter

  View on GitHub
  The Django Model Path Converter package dynamically creates custom path converters for you models.
  ☆14Feb 15, 2023Updated 3 years ago
• stummjr / scrapy-fieldstats

  View on GitHub
  A Scrapy extension to log items coverage when the spider shuts down
  ☆19Apr 11, 2020Updated 5 years ago
• Gerapy / GerapyProxy

  View on GitHub
  A package for supporting proxy in Scrapy & Gerapy
  ☆11Jul 15, 2020Updated 5 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• scrapy-plugins / scrapy-splash

  View on GitHub
  Scrapy+Splash for JavaScript integration
  ☆3,232Feb 11, 2025Updated last year
• scrapy-plugins / scrapy-zyte-smartproxy

  View on GitHub
  Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy
  ☆366Mar 24, 2025Updated last year
• rmax / scrapy-inline-requests

  View on GitHub
  A decorator to write coroutine-like spider callbacks.
  ☆109Dec 26, 2022Updated 3 years ago
• scrapinghub / web-poet

  View on GitHub
  Web scraping Page Objects core library
  ☆105Mar 10, 2026Updated 2 weeks ago
• scrapy-plugins / scrapy-headless

  View on GitHub
  ☆29Apr 28, 2021Updated 4 years ago
• wuyue92tree / crwy

  View on GitHub
  一个简单的web爬虫框架，借鉴scrapy结构开发而来，并为scrapy使用者提供通用轮子^.^
  ☆13Nov 9, 2020Updated 5 years ago
• tenlee2012 / scrapy-kafka-redis

  View on GitHub
  Distributed crawling/scraping, Kafka And Redis based components for Scrapy
  ☆45Nov 13, 2020Updated 5 years ago
• crawlaio / scrapy-redis-sentinel

  View on GitHub
  scrapy-redis-sentinel 基于 scrapy-redis 的基础上 新增 哨兵（sentinel）连接模式 以及 集群（cluster）连接模式。
  ☆30Mar 31, 2023Updated 2 years ago
• scrapinghub / webstruct

  View on GitHub
  NER toolkit for HTML data
  ☆259May 3, 2024Updated last year
• NordVPN Special Discount Offer • Ad
  Save on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
• CooperMin / qichacha

  View on GitHub
  企查查企业分类信息采集
  ☆43Apr 2, 2020Updated 5 years ago
• AccordBox / awesome-scrapy

  View on GitHub
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆558Dec 28, 2022Updated 3 years ago
• inlike / CookiePool

  View on GitHub
  一个强大的Cookie池项目，融合scrapy/requests/chrome储存cookie/cookie字符串/selenium等cookie形式
  ☆233Mar 13, 2020Updated 6 years ago
• scrapinghub / scrapy-frontera

  View on GitHub
  More flexible and featured Frontera scheduler for Scrapy
  ☆36Jun 6, 2025Updated 9 months ago
• Python3WebSpider / ScrapyRedisBloomFilter

  View on GitHub
  Scrapy Redis Bloom Filter
  ☆176Jul 25, 2021Updated 4 years ago
• TeamHG-Memex / arachnado

  View on GitHub
  Web Crawling UI and HTTP API, based on Scrapy and Tornado
  ☆161Feb 10, 2026Updated last month
• scrapy-plugins / scrapy-playwright

  View on GitHub
  🎭 Playwright integration for Scrapy
  ☆1,381Jan 21, 2026Updated 2 months ago
• my8100 / logparser

  View on GitHub
  A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
  ☆94Jan 5, 2025Updated last year
• dfdeshom / scrapy-kafka

  View on GitHub
  Kafka-based components for Scrapy
  ☆78Apr 10, 2018Updated 7 years ago
• Virtual machines for every use case on DigitalOcean • Ad
  Get dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
• scrapinghub / scrapyrt

  View on GitHub
  HTTP API for Scrapy spiders
  ☆881Mar 20, 2026Updated last week
• sml2h3 / 12306SDK

  View on GitHub
  正在写的12306调用SDK，将内置验证码识别工具，提供常用的12306的api
  ☆14Jul 17, 2019Updated 6 years ago
• Python3WebSpider / Scrape

  View on GitHub
  Platform of Web Views to Scrape
  ☆11Jun 7, 2020Updated 5 years ago
• bytebuff / aioScrapy

  View on GitHub
  基于asyncio与aiohttp的异步协程爬虫框架 欢迎Star
  ☆35Oct 25, 2019Updated 6 years ago
• q-m / scrapyd-k8s

  View on GitHub
  Scrapyd on container infrastructure
  ☆16Apr 11, 2025Updated 11 months ago
• miyakogi / pyppeteer

  View on GitHub
  Headless chrome/chromium automation library (unofficial port of puppeteer)
  ☆3,560Aug 5, 2021Updated 4 years ago
• istresearch / scrapy-cluster

  View on GitHub
  This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
  ☆1,230Nov 7, 2023Updated 2 years ago