scrapinghub / web-poetView external linksLinks
Web scraping Page Objects core library
☆104Jan 27, 2026Updated 2 weeks ago
Alternatives and similar repositories for web-poet
Users that are interested in web-poet are comparing it to the libraries listed below
Sorting:
- Page Object pattern for Scrapy☆126Jan 28, 2026Updated 2 weeks ago
- Automatic unit test generation for Scrapy.☆57Jul 12, 2021Updated 4 years ago
- Zyte API integration for Scrapy☆40Updated this week
- Pluggable DSL that uses pipes to perform a series of linear transformations to extract data☆16Jul 9, 2024Updated last year
- Scrapy Extension for monitoring spiders execution.☆553Updated this week
- Spider templates for automatic crawlers.☆34Jan 8, 2026Updated last month
- Library to populate items using XPath and CSS with a convenient API☆47Jan 29, 2026Updated 2 weeks ago
- ☆18Oct 6, 2025Updated 4 months ago
- Python clients for Zyte AutoExtract API☆41Jan 17, 2022Updated 4 years ago
- ☆16Apr 24, 2024Updated last year
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Mar 26, 2021Updated 4 years ago
- Remove DIVs, style stuff and normalize HTML preserving structure information☆14Oct 24, 2025Updated 3 months ago
- Extract price amount and currency symbol from a raw text string☆347Updated this week
- A library to make it easier to load input URLs to start scrapy processes☆14Feb 21, 2021Updated 4 years ago
- Convert Javascript code to an XML document☆187Mar 14, 2022Updated 3 years ago
- Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.☆76Mar 18, 2022Updated 3 years ago
- A complimentary proxy to help to use SPM with headless browsers☆108May 29, 2023Updated 2 years ago
- is an attempt to create a programming language, with a syntax similar to LISP☆17Feb 21, 2019Updated 6 years ago
- 🎭 Playwright integration for Scrapy☆1,361Jan 21, 2026Updated 3 weeks ago
- HTTP API for Scrapy spiders☆879Updated this week
- ☆20Jan 14, 2026Updated last month
- Scrapyd on container infrastructure☆16Apr 11, 2025Updated 10 months ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Jan 14, 2026Updated last month
- More flexible and featured Frontera scheduler for Scrapy☆36Jun 6, 2025Updated 8 months ago
- 🕶 Awesome list of Scrapy tools and libraries☆61Jul 6, 2020Updated 5 years ago
- Zyte Automatic Extraction integration for Scrapy☆56Feb 4, 2022Updated 4 years ago
- Extract text from HTML☆134Updated this week
- A modern TypeScript/JavaScript library for interacting with the Asterisk REST Interface (ARI), offering robust WebSocket support for real…☆15Aug 15, 2025Updated 6 months ago
- A collection of patterns to solve problems in Django. Makes up the site DjangoPatterns.com. Fork, contribute, and issue a pull request.☆16Dec 17, 2022Updated 3 years ago
- I’m trying to create something similar to Grammarly. Hail to open source!☆15Jun 5, 2025Updated 8 months ago
- Common interface for data container classes☆68Jan 8, 2026Updated last month
- A pure-Python robots.txt parser with support for modern conventions.☆79Jan 29, 2026Updated 2 weeks ago
- Stoq server☆15Jul 23, 2021Updated 4 years ago
- ☆15Jan 21, 2026Updated 3 weeks ago
- A fork of http://pydispatcher.sourceforge.net/ with PyPy support☆16Jul 3, 2017Updated 8 years ago
- Python dict-like interface for merging dicts with add to set property☆14Nov 14, 2018Updated 7 years ago
- Provides technical doc in ebook formats☆13Mar 26, 2013Updated 12 years ago
- Nuvem de palavras do Plano de Governo dos candidatos à Presidência da República 2018☆11Feb 10, 2023Updated 3 years ago
- estela, an elastic web scraping cluster 🕸☆194Jan 23, 2026Updated 3 weeks ago