NikolaiT / GoogleScraper
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
☆2,683Updated 3 years ago
Alternatives and similar repositories for GoogleScraper:
Users that are interested in GoogleScraper are comparing it to the libraries listed below
- Javascript scraping module based on puppeteer for many different search engines...☆557Updated 2 years ago
- Google search from Python (unofficial).☆1,193Updated 11 months ago
- A pure-python HTML screen-scraping library☆1,870Updated 2 years ago
- A Python bot that automates several actions on Twitter, such as following users and favoriting tweets.☆1,323Updated 2 years ago
- use multiple proxies with Scrapy☆754Updated 2 years ago
- Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon☆285Updated 7 years ago
- Just the facts -- web page content extraction☆1,262Updated 8 months ago
- A Python wrapper around the Twitter API.☆3,411Updated 7 months ago
- Random User-Agent middleware based on fake-useragent☆695Updated last year
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆427Updated 2 years ago
- Provides content not accessible through the standard Amazon API☆234Updated 7 years ago
- Extract embedded metadata from HTML markup☆898Updated last week
- Summarizes news articles☆1,169Updated 3 years ago
- SEO python scraper to extract data from major searchengine result pages. Extract data like url, title, snippet, richsnippet and the type …☆261Updated 2 years ago
- A simple Python wrapper for the Amazon.com Product Advertising API ⛺☆822Updated 4 years ago
- Web Scraping Framework☆2,402Updated last year
- List of libraries, tools and APIs for web scraping and data processing.☆6,949Updated 3 months ago
- Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Ana…☆2,121Updated 5 years ago
- Python SDK for Facebook's Graph API☆2,758Updated 7 months ago
- Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages☆543Updated 3 years ago
- Random proxy middleware for Scrapy☆1,667Updated 5 years ago
- HTTP API for Scrapy spiders☆851Updated 9 months ago
- Simple web scraping for Google Chrome.☆343Updated 14 years ago
- Facepy makes it really easy to use Facebook's Graph API with Python☆858Updated 4 years ago
- Html Content / Article Extractor, web scrapping lib in Python☆4,024Updated 3 years ago
- Python Twitter API☆3,246Updated last month
- next generation web crawling using machine intelligence☆331Updated last year
- Heuristic based boilerplate removal tool☆764Updated last month
- Python Client for Instagram API☆3,034Updated 4 years ago
- Scrape the Google search result with Scrapy.☆98Updated 5 years ago