ThomasAitken / scrapy-sessions
A session-management extension for Scrapy.
☆11Updated last year
Alternatives and similar repositories for scrapy-sessions:
Users that are interested in scrapy-sessions are comparing it to the libraries listed below
- Pyppeteer integration for Scrapy☆59Updated 3 years ago
- Page Object pattern for Scrapy☆119Updated this week
- ☆29Updated 3 years ago
- Zyte Automatic Extraction integration for Scrapy☆56Updated 2 years ago
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆120Updated 3 months ago
- Library to populate items using XPath and CSS with a convenient API☆45Updated 3 months ago
- Scrapy + Puppeteer☆111Updated 3 years ago
- Zyte API integration for Scrapy☆37Updated this week
- A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.☆90Updated 2 weeks ago
- Scrapy project template. Use it to quickly spin up a new web scraping project☆18Updated 2 months ago
- A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them☆66Updated last year
- Python powered way to get a unique Tor IP☆66Updated 9 months ago
- A scrapy extension to sync `.scrapy` folder to an S3 bucket☆17Updated 2 years ago
- Web scraping Page Objects core library☆95Updated 3 months ago
- ScrapingAnt API client for Python.☆36Updated 6 months ago
- ☆124Updated last year
- Common interface for data container classes☆61Updated last month
- A reimplementation of the Selenium API, emulating human interactions☆73Updated last year
- Python type wrappers for Chrome DevTools Protocol (CDP)☆107Updated last year
- Spider templates for automatic crawlers.☆25Updated this week
- A complimentary proxy to help to use SPM with headless browsers☆109Updated last year
- Use pyppeteer from a Scrapy spider☆60Updated 4 years ago
- ☆255Updated 3 years ago
- toraio - a pool of proxies, shifting on each request [not maintained, please use https://github.com/ultrafunkamsterdam/aionion]☆46Updated last year
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- Simple tool to convert curl requests to scrapy.☆44Updated 3 years ago
- aiohttp-like interface to chromium. based on selenium_driverless to bypass cloudflare☆51Updated 2 months ago
- ☆163Updated 4 years ago
- Extract Social Profiles using Email Addresses (Python)☆14Updated 6 years ago
- Minimal set of tools to conduct stealthy scraping.☆153Updated last year