Alternatives and similar repositories for python-common-crawl-amazon-example

Users that are interested in python-common-crawl-amazon-example are comparing it to the libraries listed below

• hellpanderrr / linkedin-pdf-parsing
  Parsing resumes in a PDF format from linkedIn
  ☆68Updated 8 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆57Updated last year
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆119Updated last year
• DusanMadar / ScrapeMeAgain
  Yet another Python web scraping application
  ☆29Updated 5 years ago
• TeamHG-Memex / deep-deep
  Adaptive crawler which uses Reinforcement Learning methods
  ☆169Updated 7 years ago
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆131Updated last year
• iamtodor / angel.co-companies-list-scraping
  ☆62Updated last year
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆191Updated 3 years ago
• commoncrawl / cc-mrjob
  Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
  ☆167Updated 3 years ago
• invana / crawlerflow
  Web Crawlers orchestration framework that lets you create datasets from multiple web sources using yaml configurations.
  ☆34Updated last year
• kootenpv / sky
  next generation web crawling using machine intelligence
  ☆330Updated last year
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆98Updated 5 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated last year
• melvynator / ELK_twitter
  This is a data pipeline for Twitter (ETL) using the elastic stack Elasticsearch, Logstash and Kibana (version 6.1)
  ☆58Updated 7 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆45Updated 4 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• eloyz / reddit
  Scrapy (Python Framework) Example using reddit.com
  ☆54Updated 6 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆90Updated 3 years ago
• kashaziz / rotating-proxy-python
  Python script for rotation through Proxy Servers
  ☆30Updated 6 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 7 years ago
• TeamHG-Memex / autologin
  A project to attempt to automatically login to a website given a single seed
  ☆125Updated 2 years ago
• ericfourrier / scrape-linkedin
  Scrape a public LinkedIn profile.
  ☆154Updated this week
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated last year
• tasdikrahman / spammy
  Spam filtering made easy for you
  ☆142Updated 5 years ago
• skcript / cvscan
  Your not so typical resume parser
  ☆51Updated 4 years ago
• varadchoudhari / LinkedIn-Skills-Crawler
  A simple Python script to crawl complete list of LinkedIn skills
  ☆121Updated 7 years ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago