ispras / scrapy-puppeteer
Library that helps use puppeteer in scrapy.
☆52Updated 3 weeks ago
Alternatives and similar repositories for scrapy-puppeteer:
Users that are interested in scrapy-puppeteer are comparing it to the libraries listed below
- Common interface for data container classes☆67Updated last month
- Pyppeteer integration for Scrapy☆58Updated 4 years ago
- A special service that runs puppeteer instances.☆16Updated 2 months ago
- Web scraping Page Objects core library☆99Updated 2 months ago
- Page Object pattern for Scrapy☆121Updated 2 months ago
- Scrapy + Puppeteer☆110Updated 3 years ago
- A complimentary proxy to help to use SPM with headless browsers☆108Updated last year
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Scrapfly Python SDK for headless browsers and proxy rotation☆41Updated this week
- Library to populate items using XPath and CSS with a convenient API☆48Updated last month
- More flexible and featured Frontera scheduler for Scrapy☆37Updated 5 months ago
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- Extract text from HTML☆135Updated 4 years ago
- Zyte API integration for Scrapy☆38Updated 3 weeks ago
- Pre-built Scrapy spiders for AutoExtract☆19Updated last year
- Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the …☆36Updated 9 months ago
- Parse numbers written in natural language☆114Updated 6 months ago
- Spider templates for automatic crawlers.☆29Updated last week
- Scrapy project boilerplate done right☆45Updated 2 months ago
- undetected chromedriver Docker☆31Updated last year
- Detect and classify pagination links☆102Updated 4 years ago
- Parsing JavaScript objects into Python data structures☆203Updated last month
- 🕷️ Scrapyd is an application for deploying and running Scrapy spiders.☆83Updated 3 weeks ago
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆153Updated this week
- ☆130Updated last year
- The Web Scraping Club Free Repository☆139Updated last week
- Redis Queue Dashboard based on FastAPI☆99Updated 3 months ago
- Automatic unit test generation for Scrapy.☆56Updated 3 years ago
- A middleware of cookies persistence for Scrapy☆28Updated 2 months ago
- A library to extract the main content from html. Developed for information on LLM and for feeding data into LangChain and LlamaIndex.☆39Updated 11 months ago