alexksikes / mass-scraping

Related projects ⓘ

Alternatives and complementary repositories for mass-scraping

• benjaminestes / pyscape-client
  A library to interface with the Linkscape API.
  ☆41Updated 6 years ago
• sensiblecodeio / scraperwiki-python
  ScraperWiki Python library for scraping and saving data
  ☆159Updated last year
• madmatah / seo-ranking-engine
  SEO Tool to track ranking of keywords on search engines (google app engine application)
  ☆47Updated 12 years ago
• openeventdata / scraper
  Scrapes sites. Gets news. Eventually events.
  ☆81Updated 8 years ago
• parul1931 / walmart
  scraping from walmart, target and homedepot website and getting data from amazon api
  ☆15Updated 8 years ago
• saymedia / seosuite
  Automated Search Engine Optimization Testing Tool
  ☆81Updated 5 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆57Updated 9 months ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 9 years ago
• kelaraj / linkedin_scrapy
  Scrape every LinkedIn public profile using Scrapy (Python)
  ☆15Updated 9 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• nikoma / social_media_monitoring
  Social media monitoring tools such as sentiment analysis, keyword tracking and more
  ☆46Updated 10 years ago
• yhorian / SEO-scripts
  Some Python scripts I use for auditing, research and lead generation.
  ☆29Updated 7 years ago
• robertoarruda / linkedin-public-dir-companies
  Crawler and scraper of the public directory of companies on LinkedIn.
  ☆25Updated 5 years ago
• AnthonySigogne / keyword-mining
  API - extract a list of keywords from a text.
  ☆18Updated 7 years ago
• jbrukh / craigsuck
  Python script that periodically probes the Craigslist RSS feeds for new listings.
  ☆39Updated 13 years ago
• PhantomInsights / forhirehelper
  A Python desktop application that makes the use of freelancing subreddits easier and faster.
  ☆34Updated 4 years ago
• DanMcInerney / search-google
  Scrape google search results
  ☆95Updated 6 years ago
• samwize / pyExtractor
  A python tool to extract data types such as email, URL, domains and phone numbers.
  ☆36Updated 11 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆90Updated 3 years ago
• opencivicdata / pupa
  framework for scraping legislative/government data
  ☆85Updated last month
• storerjeremy / python-semrush
  Python wrapper around the SEMrush API.
  ☆30Updated last year
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 10 years ago
• nicodjimenez / bus_catchers
  Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
  ☆39Updated 4 years ago
• kennyledet / Google-EmailScraper
  Scraper that searches Google based on a query and scrapes all emails found on each page.
  ☆103Updated 5 years ago
• prahladyeri / siterank
  Console program to get global ranking for a given website or domain
  ☆20Updated last year
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆128Updated last year
• minimaxir / get-data-from-photos-from-instagram-tags
  Processes data from images which are tagged with the specified Instagram tag.
  ☆13Updated 10 years ago
• sethblack / python-flask-pixel-tracking
  Simple email pixel tracking written in Python & Flask
  ☆31Updated 8 years ago