Alternatives and similar repositories for mass-scraping:

Users that are interested in mass-scraping are comparing it to the libraries listed below

• openeventdata / scraper
  Scrapes sites. Gets news. Eventually events.
  ☆85Updated 9 years ago
• benjaminestes / pyscape-client
  A library to interface with the Linkscape API.
  ☆40Updated 6 years ago
• yhorian / SEO-scripts
  Some Python scripts I use for auditing, research and lead generation.
  ☆30Updated 8 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated last year
• robertoarruda / linkedin-public-dir-companies
  Crawler and scraper of the public directory of companies on LinkedIn.
  ☆25Updated 6 years ago
• svven / summary
  Summary is a complete solution to extract the title, image and description from any URL.
  ☆18Updated last year
• madmatah / seo-ranking-engine
  SEO Tool to track ranking of keywords on search engines (google app engine application)
  ☆50Updated 12 years ago
• samwize / pyExtractor
  A python tool to extract data types such as email, URL, domains and phone numbers.
  ☆38Updated 11 years ago
• stoicaandrei / crunchbase-scraper
  Get data about companies from advanced search without the use of API
  ☆62Updated 5 years ago
• NikolaiT / scraping-amazon-reviews
  Scraping Amazon reviews using headless chrome and selenium
  ☆10Updated 6 years ago
• parul1931 / walmart
  scraping from walmart, target and homedepot website and getting data from amazon api
  ☆16Updated 8 years ago
• opencivicdata / pupa
  framework for scraping legislative/government data
  ☆85Updated 7 months ago
• lorey / socials
  👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.
  ☆46Updated 2 years ago
• nikoma / social_media_monitoring
  Social media monitoring tools such as sentiment analysis, keyword tracking and more
  ☆48Updated 11 years ago
• iandees / social_scrapers
  Various Python scripts to scrape sites that store data about you.
  ☆28Updated 11 years ago
• sensiblecodeio / scraperwiki-python
  ScraperWiki Python library for scraping and saving data
  ☆159Updated 2 years ago
• kelaraj / linkedin_scrapy
  Scrape every LinkedIn public profile using Scrapy (Python)
  ☆15Updated 10 years ago
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆131Updated last year
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• sangaline / email-spy
  A browser extension that lets you find email addresses for any domain with a single click.
  ☆71Updated 7 years ago
• akhilpo / Facebook_Bot
  A python script that interface Facebook chat to a chatbot using XMPP protocol.
  ☆29Updated 12 years ago
• AnthonySigogne / keyword-mining
  API - extract a list of keywords from a text.
  ☆18Updated 7 years ago
• fluquid / extract-social-media
  Extract social media links and account names from websites.
  ☆38Updated 4 years ago
• NUKnightLab / twxplorer
  ☆35Updated last year
• twintproject / twint-utils
  Collection of scripts for The TWINT project
  ☆54Updated 5 years ago
• romitmaharjan / scraping-upwork
  Scrapes upwork.com using BeautifulSoup and Selenium
  ☆12Updated 7 years ago
• jbrukh / craigsuck
  Python script that periodically probes the Craigslist RSS feeds for new listings.
  ☆39Updated 13 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆44Updated last year
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 5 years ago
• caesar0301 / libwayback
  A library to parse Wayback Machine of archive.org to get a historical views of web pages. It is a useful tool to research on the evolutio…
  ☆20Updated 6 years ago