naqushab / SearchEngineScrapy

Related projects ⓘ

Alternatives and complementary repositories for SearchEngineScrapy

• DongshaoZ / aliexpress
  A simple AliExpress spider to crawl all products with Scrapy.
  ☆17Updated 7 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 4 years ago
• aaldaber / Distributed-Multi-User-Scrapy-System-with-a-Web-UI
  Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner
  ☆113Updated 6 years ago
• EdmundMartin / SearchScraperAPI
  Aiohttp web server API, which scrapes Google and returns scrape results as response. Supports proxies, multiple geos and number of result…
  ☆53Updated 9 months ago
• AnthonySigogne / keyword-mining
  API - extract a list of keywords from a text.
  ☆18Updated 7 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆57Updated 9 months ago
• scrapinghub / autoextract-spiders
  Pre-built Scrapy spiders for AutoExtract
  ☆19Updated 6 months ago
• tal95shah / LinkedIn_Scraper
  A Selenium based automated program that scrapes profiles data,stores in CSV,follows them and saves their profile in PDF.
  ☆32Updated 11 months ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆50Updated 6 years ago
• coreymcmahon / SeoPy
  (Abandonware) SEO tools, Python style. Check keyword competition, PageRank, etc.
  ☆53Updated 12 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆55Updated 2 years ago
• nicholaskajoh / devsearch
  A web search engine built with Python which uses TF-IDF and PageRank to sort search results.
  ☆54Updated 3 years ago
• LogicLady / email-saga
  Extract Social Profiles using Email Addresses (Python)
  ☆14Updated 6 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆44Updated 3 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆42Updated last year
• amansrivastava17 / google_related_searches
  🕵 Given a user query this python module will returns a list of related searches you see on Google search results pages.
  ☆11Updated 6 years ago
• madmatah / seo-ranking-engine
  SEO Tool to track ranking of keywords on search engines (google app engine application)
  ☆47Updated 12 years ago
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆129Updated last year
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 3 years ago
• xtt129 / seCrawler
  A scrapy project can crawl search result of Google/Bing/Baidu
  ☆76Updated 6 years ago
• sunshineatnoon / Scrapy-Amazon-Sqlite
  This is a project crawling backpack information and images from Amazon using python scrapy and store data to sqlite database.
  ☆34Updated 9 years ago
• scrapinghub / portia2code
  ☆49Updated 2 years ago
• julien-duponchelle / scrapy-elasticsearch
  A scrapy pipeline which send items to Elastic Search server
  ☆98Updated 6 years ago
• romitmaharjan / scraping-upwork
  Scrapes upwork.com using BeautifulSoup and Selenium
  ☆12Updated 7 years ago
• sangaline / email-spy
  A browser extension that lets you find email addresses for any domain with a single click.
  ☆68Updated 7 years ago
• TeamHG-Memex / domain-discovery-crawler
  Broad crawler for domain discovery
  ☆19Updated 6 years ago
• zytedata / zyte-smartproxy-headless-proxy
  A complimentary proxy to help to use SPM with headless browsers
  ☆110Updated last year
• danilopolani / rotating-proxy-python
  Rotating proxy crawler in Python
  ☆82Updated 2 years ago