Alternatives and similar repositories for mass-scraping:

Users that are interested in mass-scraping are comparing it to the libraries listed below

• benjaminestes / pyscape-client
  A library to interface with the Linkscape API.
  ☆40Updated 6 years ago
• openeventdata / scraper
  Scrapes sites. Gets news. Eventually events.
  ☆83Updated 8 years ago
• madmatah / seo-ranking-engine
  SEO Tool to track ranking of keywords on search engines (google app engine application)
  ☆47Updated 12 years ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• parul1931 / walmart
  scraping from walmart, target and homedepot website and getting data from amazon api
  ☆15Updated 8 years ago
• NikolaiT / scraping-amazon-reviews
  Scraping Amazon reviews using headless chrome and selenium
  ☆10Updated 6 years ago
• jordan-wright / rapportive
  Python library to automate Rapportive queries
  ☆172Updated 10 years ago
• nikoma / social_media_monitoring
  Social media monitoring tools such as sentiment analysis, keyword tracking and more
  ☆47Updated 11 years ago
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆130Updated last year
• junekihong / linkedInScraper
  Scrapes public information off of LinkedIn
  ☆110Updated 8 years ago
• ztratar / followr
  A no-frills chrome extension to gain followers on twitter through tasteful automation.
  ☆145Updated 5 years ago
• sensiblecodeio / scraperwiki-python
  ScraperWiki Python library for scraping and saving data
  ☆159Updated last year
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated 11 months ago
• iandees / social_scrapers
  Various Python scripts to scrape sites that store data about you.
  ☆28Updated 11 years ago
• guillermo-carrasco / social_ids
  Get user ids from social network handlers
  ☆12Updated 8 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 4 years ago
• AnthonySigogne / keyword-mining
  API - extract a list of keywords from a text.
  ☆18Updated 7 years ago
• stoicaandrei / crunchbase-scraper
  Get data about companies from advanced search without the use of API
  ☆59Updated 5 years ago
• yhorian / SEO-scripts
  Some Python scripts I use for auditing, research and lead generation.
  ☆29Updated 8 years ago
• samwize / pyExtractor
  A python tool to extract data types such as email, URL, domains and phone numbers.
  ☆36Updated 11 years ago
• duydo / scrapy-crunchbase
  Using Scrapy to get company profiles from http://crunchbase.com
  ☆31Updated 11 years ago
• robertoarruda / linkedin-public-dir-companies
  Crawler and scraper of the public directory of companies on LinkedIn.
  ☆25Updated 5 years ago
• opendata / Legal-Synonyms
  A semantic analysis tool to generate synonym.txt files for Solr. [RETIRED]
  ☆23Updated 8 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆44Updated 3 years ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆118Updated 7 months ago
• gjreda / craigslist-checker
  Send text when a new Craigslist posting matches a given keyword or phrase
  ☆96Updated 10 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆43Updated last year
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• alexrutherford / facebook_scraping
  Python script to query public Facebook pages via API based on keyword search. Then extracts posts and comments which matches a keyword
  ☆31Updated 10 years ago