Alternatives and similar repositories for py-parsehub:

Users that are interested in py-parsehub are comparing it to the libraries listed below

• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• HyperionGray / starbelly
  Streaming web crawler with WebSocket API
  ☆44Updated last year
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• scrapinghub / scrapinghub-entrypoint-scrapy
  Scrapy entrypoint for Scrapinghub job runner
  ☆25Updated last month
• mattdood / web_scraping_example
  Simple RSS feed reader for HackerNews.
  ☆28Updated 2 years ago
• kadnan / ScrapeGen
  A simple python tool that generates a requests/bs4 based web scraper
  ☆26Updated 2 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• scrapy / scrapy-bench
  A CLI for benchmarking Scrapy.
  ☆31Updated 4 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• FKLC / AnyAPI
  AnyAPI is a library that helps you to write any API wrapper with ease and in pythonic way.
  ☆132Updated 3 years ago
• scrapinghub / scrapy-mosquitera
  Restrict crawl and scraping scope using matchers.
  ☆25Updated 8 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 3 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆96Updated last month
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆63Updated last month
• scrapy-plugins / scrapy-splitvariants
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆20Updated 8 years ago
• rootVIII / proxy_web_crawler
  Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords
  ☆44Updated last year
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• pythad / selenium_extensions
  Tools that will make writing tests, bots and scrapers using Selenium much easier
  ☆140Updated 3 months ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• CompileInc / hodor
  🕷Configuration based html scraper
  ☆23Updated 3 weeks ago
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆205Updated 3 weeks ago
• scrapinghub / autoextract-spiders
  Pre-built Scrapy spiders for AutoExtract
  ☆19Updated 10 months ago
• alttch / atasker
  Python library for modern thread / multiprocessing pooling and task processing via asyncio
  ☆15Updated 4 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• codingforentrepreneurs / Supercharged-Web-Scraping-with-Asyncio
  Scrape websites asynchronously with Python 3.8+, Asyncio, & arsenic (aka Selenium for Async).
  ☆57Updated 3 years ago
• scrapy / scrapy.org
  The scrapy.org website
  ☆62Updated this week
• volfpeter / markyp-bootstrap4
  Create Bootstrap 4 web pages using purely Python.
  ☆19Updated last week
• noahgift / web_scraping_python
  Techniques for Scraping the Web in Python
  ☆26Updated 6 years ago