lobstrio / shadow-useragent
Pick the most common user-agents on the Internet π»
β168Updated 4 years ago
Alternatives and similar repositories for shadow-useragent:
Users that are interested in shadow-useragent are comparing it to the libraries listed below
- A Scrapy middleware to bypass the CloudFlare's anti-bot protectionβ109Updated 3 years ago
- Software stack with latest Scrapy and updated depsβ64Updated 2 months ago
- Parsing JavaScript objects into Python data structuresβ204Updated last month
- Generator of User-Agent headerβ339Updated 9 months ago
- Scrapy Extension for monitoring spiders execution.β541Updated this week
- Extract price amount and currency symbol from a raw text stringβ324Updated 2 months ago
- Page Object pattern for Scrapyβ121Updated 2 months ago
- Zyte API integration for Scrapyβ38Updated last week
- use multiple proxies with Scrapyβ756Updated 2 years ago
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.β122Updated 10 months ago
- A complimentary proxy to help to use SPM with headless browsersβ108Updated last year
- Python module/library for retrieving domain WHOIS information (only domain)β290Updated last year
- python library for getting metadataβ144Updated 3 weeks ago
- Sample projects showcasing Scrapinghub techβ138Updated last year
- SOCKS proxy enabled Email Verifierβ107Updated last year
- An automatic proxy rotator - multithreaded & SSLβ81Updated 3 years ago
- Python powered way to get a unique Tor IPβ66Updated last year
- Client library for solve captchas with Anticaptcha.com support.β224Updated 3 years ago
- β129Updated last year
- A reimplementation of the Selenium API, emulating human interactionsβ75Updated last year
- Automatic unit test generation for Scrapy.β56Updated 3 years ago
- A python script to query Amazon's Alexa Web Information Service (AWIS).β37Updated last year
- Proxying Python Requestsβ150Updated 3 years ago
- Python library for scraping google search resultsβ115Updated 4 months ago
- Web scraping Page Objects core libraryβ99Updated 2 months ago
- β38Updated 7 years ago
- A package to get list of user agents based on filters such as operating system, software name etc..β97Updated 9 months ago
- Detect and classify pagination linksβ102Updated 4 years ago
- Python clients for Zyte AutoExtract APIβ40Updated 3 years ago
- Check if an email is valid with using SMTP, regexes and blacklists.This package has been migrated to https://git.ksol.io/karolyi/py3-valiβ¦β131Updated 10 months ago