Alternatives and similar repositories for booksbot

Users that are interested in booksbot are comparing it to the libraries listed below

• stummjr / books_crawler
  A Scrapy crawler for http://books.toscrape.com
  ☆27Updated 8 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• jxltom / scrapymon
  Simple Web UI for Scrapy spider management via Scrapyd
  ☆51Updated 7 years ago
• scrapinghub / scrapinghub-stack-scrapy
  Software stack with latest Scrapy and updated deps
  ☆65Updated last month
• zytedata / zyte-smartproxy-headless-proxy
  A complimentary proxy to help to use SPM with headless browsers
  ☆108Updated 2 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 3 years ago
• scrapy / scrapy.org
  The scrapy.org website
  ☆65Updated 4 months ago
• scrapinghub / shub
  Scrapinghub Command Line Client
  ☆132Updated last month
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 8 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• scrapy-plugins / scrapy-headless
  ☆28Updated 4 years ago
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆204Updated 7 months ago
• povilasb / scrapy-html-storage
  Scrapy downloader middleware that stores response HTMLs to disk.
  ☆18Updated last month
• scrapinghub / sample-projects
  Sample projects showcasing Scrapinghub tech
  ☆138Updated last year
• woxcab / scrapy_rss
  Tools to easy generate RSS feed that contains each scraped item using Scrapy framework.
  ☆33Updated last week
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• zytedata / zyte-autoextract
  Python clients for Zyte AutoExtract API
  ☆40Updated 3 years ago
• sangaline / scrapy-wayback-machine
  A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
  ☆117Updated last year
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆57Updated last year
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 4 years ago
• robertoarruda / linkedin-public-dir-companies
  Crawler and scraper of the public directory of companies on LinkedIn.
  ☆25Updated 6 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago
• scrapy / loginform
  Fill HTML login forms automatically
  ☆275Updated last year
• CNuge / email-report
  A modular template for scraping data from the web to send yourself scheduled email reports
  ☆41Updated 5 years ago
• googledatastudio / ds-data-registry
  A registry of data sources, categories, and organizations to use with Data Studio Community Connectors.
  ☆90Updated last week
• healeycodes / Broken-Link-Crawler
  Python bot that crawls your website looking for dead stuff
  ☆43Updated 2 years ago
• varadchoudhari / LinkedIn-Skills-Crawler
  A simple Python script to crawl complete list of LinkedIn skills
  ☆121Updated 7 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆91Updated 3 years ago
• scrapy / scrapy-bench
  A CLI for benchmarking Scrapy.
  ☆32Updated 2 months ago