lobstrio / shadow-useragent
Pick the most common user-agents on the Internet 👻
☆168Updated 4 years ago
Alternatives and similar repositories for shadow-useragent:
Users that are interested in shadow-useragent are comparing it to the libraries listed below
- A Scrapy middleware to bypass the CloudFlare's anti-bot protection☆109Updated 3 years ago
- Parsing JavaScript objects into Python data structures☆202Updated last week
- Zyte API integration for Scrapy☆38Updated 2 weeks ago
- Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of result…☆56Updated last year
- A reimplementation of the Selenium API, emulating human interactions☆74Updated last year
- Detect and classify pagination links☆102Updated 4 years ago
- Software stack with latest Scrapy and updated deps☆63Updated last month
- Scrapy middleware which allows to crawl only new content☆80Updated 2 years ago
- Extract text from HTML☆134Updated 4 years ago
- Rotating proxy crawler in Python☆82Updated 3 years ago
- Python library for scraping google search results☆115Updated 3 months ago
- use multiple proxies with Scrapy☆754Updated 2 years ago
- An automatic proxy rotator - multithreaded & SSL☆81Updated 3 years ago
- A Python wrapper for the Hunter.io v2 API☆124Updated 2 years ago
- Python library for automating the administration of Google Alerts.☆98Updated 2 years ago
- A generic crawler☆78Updated 6 years ago
- Client library for solve captchas with Anticaptcha.com support.☆224Updated 2 years ago
- A client interface for Scrapinghub's API☆205Updated last month
- 🕶 Awesome list of Scrapy tools and libraries☆59Updated 4 years ago
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- ☆130Updated 6 years ago
- A project to attempt to automatically login to a website given a single seed☆123Updated 2 years ago
- Scrape public FaceBook posts from any group or user into a .csv file without needing to register for any API access☆48Updated 5 years ago
- Scrape the Google search result with Scrapy.☆98Updated 5 years ago
- A middleware layer for Scrapy that detects CAPTCHA tests and solves them☆45Updated last year
- Python clients for Zyte AutoExtract API☆40Updated 3 years ago
- SOCKS proxy enabled Email Verifier☆106Updated 11 months ago
- Python API for parsehub.com web scraping service☆45Updated 6 years ago
- Basic setup with random user agents and IP addresses for Python Scrapy Framework.☆58Updated 7 years ago
- A wrapper for the Google Search Console API.☆225Updated 10 months ago