Alternatives and similar repositories for python-common-crawl-amazon-example:

Users that are interested in python-common-crawl-amazon-example are comparing it to the libraries listed below

• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆55Updated last year
• gfjreg / CommonCrawl
  A distributed system for mining common crawl using SQS, AWS-EC2 and S3
  ☆18Updated 10 years ago
• TeamHG-Memex / deep-deep
  Adaptive crawler which uses Reinforcement Learning methods
  ☆170Updated 6 years ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• shiv-prasad / indeed_scrapper
  Scrapper and Parser for Indeed Jobs and Resumes using Python, BeautifulSoup and Selenium/Requests and storing and manipulating data using…
  ☆21Updated 2 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆45Updated 3 years ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆118Updated 8 months ago
• psolbach / metadoc
  Aviation grade news article metadata extraction
  ☆36Updated last year
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• scrapinghub / page_clustering
  A simple algorithm for clustering web pages, suitable for crawlers
  ☆34Updated 7 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• cldellow / real-estate-prices-cc
  Source real estate prices from the Common Crawl.
  ☆27Updated 6 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• skulltech / validate-email-bulk
  Bulk email validation. Deploy on server with Redis or as serverless webapp with AWS.
  ☆13Updated 5 years ago
• ines / spacy-graphql
  🤹‍♀️ Query spaCy's linguistic annotations using GraphQL
  ☆86Updated 6 years ago
• thavelick / summarize
  A python library for simple text summarization
  ☆219Updated 9 years ago
• dcondrey / scrapy-spiders
  Collection of python scripts I have created to crawl various websites, mostly for lead generation projects to match keywords and collect …
  ☆131Updated last year
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 8 years ago
• seagatesoft / webdext
  Intelligent Web Data Extractor
  ☆74Updated 2 years ago
• AnthonySigogne / keyword-mining
  API - extract a list of keywords from a text.
  ☆18Updated 7 years ago
• idwaker / linkedin
  Linkedin crawler to search and collect user data
  ☆52Updated 6 years ago
• cirlabs / citizen-quotes
  A project to demonstrate maximum entropy models for extracting quotes from news articles in Python.
  ☆49Updated 12 years ago
• kororo / excelcy
  Excel Integration with spaCy. Training NER using Excel/XLSX from PDF, DOCX, PPT, PNG or JPG.
  ☆105Updated 2 years ago
• fluquid / extract-social-media
  Extract social media links and account names from websites.
  ☆37Updated 4 years ago
• NISH1001 / medium-crawler
  A crawler for scraping posts from medium.com
  ☆64Updated 5 years ago
• invana / crawlerflow
  Web Crawlers orchestration framework that lets you create datasets from multiple web sources using yaml configurations.
  ☆34Updated last year
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 7 years ago
• ericfourrier / scrape-linkedin
  Scrape a public LinkedIn profile.
  ☆153Updated 7 months ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated 9 months ago