đ Playwright integration for Scrapy
â1,379Jan 21, 2026Updated 2 months ago
Alternatives and similar repositories for scrapy-playwright
Users that are interested in scrapy-playwright are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Page Object pattern for Scrapyâ128Mar 15, 2026Updated last week
- Downloader Middleware to support Playwright in Scrapy & Gerapyâ111Mar 6, 2022Updated 4 years ago
- Scrapy Extension for monitoring spiders execution.â552Mar 20, 2026Updated last week
- playwright stealthâ915Jul 29, 2024Updated last year
- Scrapy+Splash for JavaScript integrationâ3,233Feb 11, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI ⢠AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scrapy middleware to handle javascript pages using seleniumâ958Jul 8, 2024Updated last year
- Web scraping Page Objects core libraryâ105Mar 10, 2026Updated 2 weeks ago
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.â227Feb 21, 2026Updated last month
- Python version of the Playwright testing and automation library.â14,419Mar 19, 2026Updated last week
- Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.âŚâ3,406Feb 19, 2025Updated last year
- HTTP API for Scrapy spidersâ881Mar 20, 2026Updated last week
- Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.jsâ3,501Oct 29, 2024Updated last year
- Web grep: search all rendered resources used by a URIâ89Nov 21, 2025Updated 4 months ago
- Scrapy schema validation pipeline and Item builder using JSON Schemaâ45Mar 26, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean ⢠AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A service daemon to run Scrapy spidersâ3,088Mar 19, 2026Updated last week
- use multiple proxies with Scrapyâ773Feb 10, 2026Updated last month
- Lightweight, scriptable browser as a service with an HTTP APIâ4,202Aug 2, 2024Updated last year
- Zyte API integration for Scrapyâ40Mar 19, 2026Updated last week
- Library to populate items using XPath and CSS with a convenient APIâ48Jan 29, 2026Updated last month
- Parsel lets you extract data from XML/HTML documents using XPath or CSS selectorsâ1,321Jan 29, 2026Updated last month
- â146Nov 6, 2023Updated 2 years ago
- â71Nov 17, 2023Updated 2 years ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.â558Dec 28, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways ⢠AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Parsing JavaScript objects into Python data structuresâ218Aug 4, 2025Updated 7 months ago
- Scrapy, a fast high-level web crawling & scraping framework for Python.â60,886Mar 19, 2026Updated last week
- Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.â57Mar 16, 2022Updated 4 years ago
- â167Mar 4, 2020Updated 6 years ago
- â21Mar 4, 2021Updated 5 years ago
- Common interface for data container classesâ68Mar 16, 2026Updated last week
- Scrapyd on container infrastructureâ16Apr 11, 2025Updated 11 months ago
- Scrapoxy has been discontinued.â2,425Feb 7, 2026Updated last month
- Redis-based components for Scrapy.â5,636Jul 6, 2024Updated last year
- Virtual machines for every use case on DigitalOcean ⢠AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A scrapy extension to sync `.scrapy` folder to an S3 bucketâ18Mar 28, 2022Updated 3 years ago
- Pyppeteer integration for Scrapyâ58Feb 26, 2021Updated 5 years ago
- Command line client for Scrapyd serverâ777Feb 27, 2026Updated last month
- đ Web scraping for humansâ994Dec 1, 2024Updated last year
- Random User-Agent middleware based on fake-useragentâ689Sep 18, 2023Updated 2 years ago
- Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapyâ366Mar 24, 2025Updated last year
- Scrapy + Puppeteerâ110Jun 11, 2021Updated 4 years ago