Alternatives and similar repositories for ScrapeMeAgain:

Users that are interested in ScrapeMeAgain are comparing it to the libraries listed below

• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• guillermo-carrasco / social_ids
  Get user ids from social network handlers
  ☆12Updated 8 years ago
• TeamHG-Memex / docker-tor-rotator
  A rotating socks proxy using Tor, Delegate and Haproxy
  ☆14Updated 5 years ago
• HyperionGray / starbelly
  Streaming web crawler with WebSocket API
  ☆42Updated last year
• lorey / socials
  👨‍👩‍👦 Social account detection and extraction in Python, e.g. for crawling/scraping.
  ☆46Updated 2 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆43Updated last year
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆55Updated last year
• isaacmg / fb_scraper
  FBLYZE is a Facebook scraping system and analysis system.
  ☆64Updated 3 years ago
• WiliTest / Anonymous-scrapping-Scrapy-Tor-Privoxy-UserAgent
  Example of how to use scrapy without getting caught (ex: changing IP) (+ info to set it on windows 10)
  ☆42Updated 5 years ago
• lspahija / torchestrator
  Spin up Tor containers and then proxy HTTP requests via these Tor instances
  ☆43Updated 3 years ago
• iamtodor / angel.co-companies-list-scraping
  ☆62Updated 8 months ago
• naqushab / SearchEngineScrapy
  Scrape data from Google.com, Bing.com, Baidu.com, Ask.com, Yahoo.com, Yandex.com
  ☆56Updated 3 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• DusanMadar / TorIpChanger
  Python powered way to get a unique Tor IP
  ☆66Updated 10 months ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 4 years ago
• TeamHG-Memex / domain-discovery-crawler
  Broad crawler for domain discovery
  ☆19Updated 6 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• scrapehero / walmart-coupons
  Walmart Web Scraper written in Python 3 to extract coupon details for a store location
  ☆14Updated 6 years ago
• samwize / pyExtractor
  A python tool to extract data types such as email, URL, domains and phone numbers.
  ☆36Updated 11 years ago
• fluquid / extract-social-media
  Extract social media links and account names from websites.
  ☆37Updated 4 years ago
• DanMcInerney / search-google
  Scrape google search results
  ☆95Updated 6 years ago
• 9b / frisbee
  Collect email addresses by crawling search engine results.
  ☆29Updated 2 years ago
• satendrapandeymp / Fb_details_scrapper
  Scrape peoples detail from facebook.
  ☆14Updated 4 years ago
• minimaxir / get-data-from-photos-from-instagram-tags
  Processes data from images which are tagged with the specified Instagram tag.
  ☆13Updated 10 years ago
• gfjreg / CommonCrawl
  A distributed system for mining common crawl using SQS, AWS-EC2 and S3
  ☆16Updated 10 years ago
• Leo675 / hma-scraper
  Scrapes the obfuscated proxy list at proxylist.hidemyass.com
  ☆32Updated 5 years ago
• kashaziz / rotating-proxy-python
  Python script for rotation through Proxy Servers
  ☆30Updated 6 years ago
• lanjelot / web-hunter
  Crawl Google and Bing to find emails, subdomains and URLs associated to a target domain
  ☆48Updated 3 years ago
• alexksikes / mass-scraping
  Quickly download and scrape websites on a massive scale.
  ☆65Updated 12 years ago
• apetz / email-scraper
  ☆38Updated 7 years ago