Nykakin / chompjs
Parsing JavaScript objects into Python data structures
☆190Updated last month
Related projects: ⓘ
- Page Object pattern for Scrapy☆119Updated 2 months ago
- Web scraping Page Objects core library☆93Updated 2 months ago
- Extract price amount and currency symbol from a raw text string☆312Updated 11 months ago
- Scrapy Extension for monitoring spiders execution.☆527Updated 2 months ago
- Common interface for data container classes☆61Updated last month
- Automatic unit test generation for Scrapy.☆55Updated 3 years ago
- A Scrapy middleware to bypass the CloudFlare's anti-bot protection☆105Updated 3 years ago
- Zyte API integration for Scrapy☆35Updated last week
- Web grep: search all rendered resources used by a URI☆83Updated 2 months ago
- Async WebDriver implementation for asyncio and asyncio-compatible frameworks☆350Updated 5 months ago
- 🕶 Awesome list of Scrapy tools and libraries☆54Updated 4 years ago
- Splash + HAProxy + Docker Compose☆196Updated 5 years ago
- Convert Javascript code to an XML document☆186Updated 2 years ago
- Library to populate items using XPath and CSS with a convenient API☆44Updated 3 months ago
- Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors☆1,121Updated 3 months ago
- Simple tool to convert curl requests to scrapy.☆40Updated 2 years ago
- use multiple proxies with Scrapy☆733Updated 2 years ago
- Extract text from HTML☆129Updated 4 years ago
- A crawler demo to illustrate web crawling.☆26Updated 3 years ago
- 🎭 Playwright integration for Scrapy☆979Updated last week
- The most advanced debugging and testing tool for Scrapy☆17Updated last year
- Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).☆1,096Updated 2 weeks ago
- playwright stealth☆479Updated last month
- Pyppeteer integration for Scrapy☆60Updated 3 years ago
- Generator of User-Agent header☆335Updated 2 months ago
- Library that helps use puppeteer in scrapy.☆51Updated last week
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆94Updated 2 weeks ago
- A simple, Qt-Webengine powered web browser with built in functionality for basic scrapy webscraping support.☆106Updated 3 months ago
- HTTP API for Scrapy spiders☆831Updated 2 months ago
- A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them☆66Updated last year