Alternatives and similar repositories for mass-scraping:

Users that are interested in mass-scraping are comparing it to the libraries listed below

• brandonrobertz / autoscrape-py
  An automated, programming-free web scraper for interactive sites
  ☆110Updated last year
• openeventdata / scraper
  Scrapes sites. Gets news. Eventually events.
  ☆84Updated 9 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated last year
• nikoma / social_media_monitoring
  Social media monitoring tools such as sentiment analysis, keyword tracking and more
  ☆47Updated 11 years ago
• duydo / scrapy-crunchbase
  Using Scrapy to get company profiles from http://crunchbase.com
  ☆31Updated 11 years ago
• ericwhyne / http-ricochet
  A simple proxy web service in 19 lines of Python code.
  ☆23Updated 10 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆44Updated last year
• gjreda / craigslist-checker
  Send text when a new Craigslist posting matches a given keyword or phrase
  ☆96Updated 10 years ago
• sburl / PricePoint-Public
  Arbitrage Engine for Amazon, eBay, and Facebook Marketplace
  ☆28Updated 6 years ago
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆131Updated last year
• sensiblecodeio / scraperwiki-python
  ScraperWiki Python library for scraping and saving data
  ☆159Updated 2 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆45Updated 4 years ago
• geekodour / pinterest-dashbot
  A Pintrest Bot using selenium
  ☆35Updated 3 years ago
• mattdood / web_scraping_example
  Simple RSS feed reader for HackerNews.
  ☆28Updated 2 years ago
• infaticaio / Google-Scraper
  Google Scraper is a Python utility for acquiring web page URLs, meta data, and other information. It can help you monitor websites for re…
  ☆18Updated 2 years ago
• cldellow / real-estate-prices-cc
  Source real estate prices from the Common Crawl.
  ☆27Updated 6 years ago
• trentmillar / opencv-product-comparer
  A crude, rude, slow, and disk heavy crawler to find you the unicorn product to sell on Amazon. This uses OpenCV and compares product imag…
  ☆45Updated 6 years ago
• kevinwuhoo / scrape-crunchbase
  Crunchbase company data in json format.
  ☆84Updated 11 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 5 years ago
• benjaminestes / pyscape-client
  A library to interface with the Linkscape API.
  ☆40Updated 6 years ago
• robertoarruda / linkedin-public-dir-companies
  Crawler and scraper of the public directory of companies on LinkedIn.
  ☆25Updated 5 years ago
• jorgenkg / python-proxy-rotator
  An automatic proxy rotator - multithreaded & SSL
  ☆81Updated 3 years ago
• sangaline / email-spy
  A browser extension that lets you find email addresses for any domain with a single click.
  ☆71Updated 7 years ago
• DusanMadar / ScrapeMeAgain
  Yet another Python web scraping application
  ☆31Updated 5 years ago
• mnmldave / scraper
  Simple web scraping for Google Chrome.
  ☆343Updated 14 years ago
• scrapinghub / autoextract-spiders
  Pre-built Scrapy spiders for AutoExtract
  ☆19Updated 11 months ago
• minimaxir / facebook-ad-library-scraper
  A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.
  ☆119Updated 5 years ago
• mdubey07 / FacebookMarketplaceScraper
  This script will scrape the product data with given search keywords.
  ☆27Updated 4 years ago
• HenleyKuang / Search-Engine-Lead-Finder
  Search Engine Lead Finder is a tool programmed in C# that researches geodemographic market segments and integrates multiple RESTful devel…
  ☆36Updated 9 years ago
• codelucas / newspaper-demo
  Demo of the Newspaper article extraction library.
  ☆29Updated 10 years ago