Alternatives and similar repositories for python-common-crawl-amazon-example

Users that are interested in python-common-crawl-amazon-example are comparing it to the libraries listed below

• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆58Updated last year
• commoncrawl / cc-mrjob
  Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
  ☆168Updated 3 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated last week
• TeamHG-Memex / deep-deep
  Adaptive crawler which uses Reinforcement Learning methods
  ☆168Updated last week
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆119Updated last week
• hellpanderrr / linkedin-pdf-parsing
  Parsing resumes in a PDF format from linkedIn
  ☆68Updated 9 years ago
• cldellow / real-estate-prices-cc
  Source real estate prices from the Common Crawl.
  ☆27Updated 7 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆93Updated 2 months ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated last year
• BernhardWenzel / google-taxonomy-matcher
  Matches a category of Google's Taxonomy to product that is described in any kind of text data
  ☆63Updated 7 years ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆192Updated 3 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• nikhilkumarsingh / gnewsclient
  An easy-to-use python client for Google News feeds.
  ☆50Updated 3 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• notpeter / crunchbase-data
  2015 CrunchBase Data Export as CSV
  ☆167Updated 9 years ago
• iamtodor / angel.co-companies-list-scraping
  ☆62Updated last year
• skcript / cvscan
  Your not so typical resume parser
  ☆51Updated 5 years ago
• scrapinghub / page_clustering
  A simple algorithm for clustering web pages, suitable for crawlers
  ☆35Updated 8 years ago
• thavelick / summarize
  A python library for simple text summarization
  ☆219Updated 10 years ago
• orangain / scrapy-s3pipeline
  Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.
  ☆76Updated 3 years ago
• scrapinghub / sample-projects
  Sample projects showcasing Scrapinghub tech
  ☆138Updated last year
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated last year
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆45Updated 4 years ago
• bloomsburyai / cape-webservices
  Entrypoint for all backend cape webservices
  ☆155Updated 7 years ago
• atbaker / wikipedia-question-generator
  Uses NLP and wikipedia to try to generate trivia questions
  ☆132Updated 8 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆205Updated 7 years ago
• kootenpv / sky
  next generation web crawling using machine intelligence
  ☆332Updated 2 years ago
• giacbrd / python-dandelion-eu
  A python client for connecting to all the services provided by https://dandelion.eu
  ☆36Updated 2 years ago
• johnpcarty / Thesaurus-of-Job-Titles
  Open Source Thesaurus of Job Titles in US English
  ☆140Updated 3 years ago