lobstrio / shadow-useragentLinks
Pick the most common user-agents on the Internet π»
β172Updated 5 years ago
Alternatives and similar repositories for shadow-useragent
Users that are interested in shadow-useragent are comparing it to the libraries listed below
Sorting:
- Python module/library for retrieving domain WHOIS information (only domain)β286Updated 2 years ago
- A Scrapy middleware to bypass the CloudFlare's anti-bot protectionβ111Updated 4 years ago
- URLExtract is python class for collecting (extracting) URLs from given text based on locating TLD.β273Updated last year
- Ultimate Website Sitemap Parserβ242Updated 2 weeks ago
- SOCKS proxy enabled Email Verifierβ109Updated last year
- β446Updated 2 weeks ago
- verify-email can verify any email address by efficiently checking the domain name and pinging the handler to verify its existence.β137Updated 3 years ago
- Async WebDriver implementation for asyncio and asyncio-compatible frameworksβ357Updated last year
- Extract price amount and currency symbol from a raw text stringβ347Updated 4 months ago
- Client library for solve captchas with Anticaptcha.com support.β225Updated 3 years ago
- use multiple proxies with Scrapyβ771Updated 2 weeks ago
- A package to get list of user agents based on filters such as operating system, software name etc..β103Updated last year
- Extract text from HTMLβ134Updated 2 weeks ago
- πΆ Awesome list of Scrapy tools and librariesβ61Updated 5 years ago
- Lightweight package to query popular search engines and scrape for result titles, links and descriptionsβ487Updated last year
- Check if an email is valid with using SMTP, regexes and blacklists.This package has been migrated to https://git.ksol.io/karolyi/py3-valiβ¦β130Updated last year
- Generator of User-Agent headerβ348Updated 4 months ago
- Proxying Python Requestsβ147Updated 4 years ago
- Python library for scraping google search resultsβ116Updated last year
- Run a Scrapy spider programmatically from a script or a Celery task - no project required.β121Updated last year
- Python library for AntiCaptcha.β163Updated 3 weeks ago
- Universal python API to captcha solving servicesβ254Updated 2 years ago
- A client interface for Scrapinghub's APIβ204Updated 4 months ago
- A generic crawlerβ78Updated this week
- Software stack with latest Scrapy and updated depsβ65Updated 3 weeks ago
- Extract embedded metadata from HTML markupβ945Updated 4 months ago
- Python3 compatible way to bypass sites guarded with Incapsulaβ201Updated 4 years ago
- List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)β459Updated 2 years ago
- URL normalization for Pythonβ99Updated 9 months ago
- Parsing JavaScript objects into Python data structuresβ217Updated 6 months ago