Alternatives and similar repositories for mass-scraping

Users that are interested in mass-scraping are comparing it to the libraries listed below

• storerjeremy / python-semrush
  Python wrapper around the SEMrush API.
  ☆30Updated last year
• iandees / social_scrapers
  Various Python scripts to scrape sites that store data about you.
  ☆28Updated 11 years ago
• InstaPy / instapy-gender-classification
  🔎 Classification helper for sex classification feature of InstaPy
  ☆34Updated last year
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• opencivicdata / pupa
  framework for scraping legislative/government data
  ☆85Updated 8 months ago
• nikoma / social_media_monitoring
  Social media monitoring tools such as sentiment analysis, keyword tracking and more
  ☆48Updated 11 years ago
• cantabular / scraperwiki-python
  ScraperWiki Python library for scraping and saving data
  ☆159Updated 2 years ago
• fluquid / extract-social-media
  Extract social media links and account names from websites.
  ☆38Updated 4 years ago
• benjaminestes / pyscape-client
  A library to interface with the Linkscape API.
  ☆40Updated 6 years ago
• isaacmg / fb_scraper
  FBLYZE is a Facebook scraping system and analysis system.
  ☆64Updated 4 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• AnthonySigogne / keyword-mining
  API - extract a list of keywords from a text.
  ☆18Updated 7 years ago
• robertoarruda / linkedin-public-dir-companies
  Crawler and scraper of the public directory of companies on LinkedIn.
  ☆25Updated 6 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• davidsilveiro / TweetSploit
  TweetSploit - Is a twitter Marketing Suite allowing for a nice and simple interface, from which you can access and automate Twitter marke…
  ☆21Updated 8 years ago
• jessecordeiro / youtube-trending-videos-scraper
  A scraper for videos that are trending on YouTube (https://www.youtube.com/feed/trending)
  ☆26Updated 3 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• yhorian / SEO-scripts
  Some Python scripts I use for auditing, research and lead generation.
  ☆30Updated 8 years ago
• jordan-wright / rapportive
  Python library to automate Rapportive queries
  ☆173Updated 10 years ago
• justinlittman / fb-ad-archive-scraper
  Scraper for Facebook's Archive of Ads with Political Content
  ☆36Updated 6 years ago
• NUKnightLab / twxplorer
  ☆35Updated last year
• alephdata / alephclient
  API client for Aleph, supports bulk entity and document upload.
  ☆28Updated 7 months ago
• kevinwuhoo / scrape-crunchbase
  Crunchbase company data in json format.
  ☆84Updated 11 years ago
• opendata / Legal-Synonyms
  A semantic analysis tool to generate synonym.txt files for Solr. [RETIRED]
  ☆24Updated 8 years ago
• parul1931 / walmart
  scraping from walmart, target and homedepot website and getting data from amazon api
  ☆16Updated 9 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆44Updated last year
• openstates / billy
  legacy backend for Open States
  ☆87Updated 5 years ago
• nasa-jpl-memex / memex-explorer
  Viewers for statistics and dashboarding of Domain Search Engine data
  ☆124Updated 9 years ago