ispras / scrapy-puppeteer
Library that helps use puppeteer in scrapy.
☆52Updated 2 weeks ago
Alternatives and similar repositories for scrapy-puppeteer:
Users that are interested in scrapy-puppeteer are comparing it to the libraries listed below
- Common interface for data container classes☆66Updated 3 weeks ago
- Page Object pattern for Scrapy☆121Updated 2 months ago
- Pyppeteer integration for Scrapy☆59Updated 4 years ago
- Scrapy + Puppeteer☆111Updated 3 years ago
- Web scraping Page Objects core library☆99Updated 2 months ago
- A special service that runs puppeteer instances.☆16Updated last month
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- A complimentary proxy to help to use SPM with headless browsers☆108Updated last year
- ☆129Updated last year
- Library to populate items using XPath and CSS with a convenient API☆48Updated 3 weeks ago
- Scrapfly Python SDK for headless browsers and proxy rotation☆41Updated 2 months ago
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- The Web Scraping Club Free Repository☆137Updated 5 months ago
- Parsing JavaScript objects into Python data structures☆204Updated last month
- Spider templates for automatic crawlers.☆28Updated 2 weeks ago
- Zyte API integration for Scrapy☆38Updated this week
- Python type wrappers for Chrome DevTools Protocol (CDP)☆110Updated last year
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆144Updated 3 weeks ago
- 🕷️ Scrapyd is an application for deploying and running Scrapy spiders.☆83Updated this week
- Python client for Zyte API☆24Updated last week
- Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.☆42Updated 3 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆136Updated 3 months ago
- Scrapy project boilerplate done right☆45Updated 2 months ago
- Official Python client for Manticore Search☆47Updated last week
- More flexible and featured Frontera scheduler for Scrapy☆36Updated 4 months ago
- Parse numbers written in natural language☆112Updated 5 months ago
- ☆20Updated 2 weeks ago
- Automatic unit test generation for Scrapy.☆56Updated 3 years ago
- Extract text from HTML☆135Updated 4 years ago
- undetected chromedriver Docker☆31Updated last year