Alternatives and similar repositories for awesome-web-scraping

Users that are interested in awesome-web-scraping are comparing it to the libraries listed below

• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 10 years ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 4 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 7 years ago
• pythad / selenium_extensions
  Tools that will make writing tests, bots and scrapers using Selenium much easier
  ☆140Updated 10 months ago
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 8 years ago
• lethain / extraction
  A Python library for extracting titles, images, descriptions and canonical urls from HTML.
  ☆151Updated 5 years ago
• opensanctions / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆71Updated 2 months ago
• rochacbruno-archive / scrapy_model
  A helper to create web scrapers using scrapy selector in a Model based structure
  ☆57Updated 2 years ago
• Parsely / serpextract
  Easy extraction of keywords and engines from search engine results pages (SERPs).
  ☆92Updated last week
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 10 years ago
• povilasb / scrapy-html-storage
  Scrapy downloader middleware that stores response HTMLs to disk.
  ☆18Updated 2 months ago
• dssg / pgdedupe
  A simple command line interface to the datamade/dedupe library.
  ☆42Updated 2 years ago
• littlecolumns / little-geocoder
  A tool to allow US addresses to be geocoded/georeferenced easily, without using Python or the command line or paid services or anything.
  ☆18Updated 2 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• Matt-Deacalion / The-Zen-of-Python-Poster
  A poster made to remind you of Tim Peters' renowned “Zen of Python”. The guiding principles of a Pythonista.
  ☆82Updated 2 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• Psycojoker / ipython-beautifulsoup
  Pretty HTML/XML rendering with syntax highlighting for BeautifulSoup objects in IPython notebook and qtconsole.
  ☆69Updated 4 years ago
• ChrisRoark / beagle_scraper
  Scraper for categories and lists on ecommerce and other listing websites
  ☆43Updated 5 years ago
• scrapy-plugins / scrapy-monkeylearn
  A Scrapy pipeline to categorize items using MonkeyLearn
  ☆37Updated 8 years ago
• tryolabs / daywatch
  E-commerce scraping and analytics platform.
  ☆53Updated 9 years ago
• di / vladiate
  A strict validation tool for CSV files
  ☆93Updated 2 months ago
• sachin-philip / beautifier
  Simple library to cleanup and prettify url patterns and emails
  ☆137Updated 3 years ago
• MartinPaulEve / PlotSummary
  Plots various graphs for a series of plaintext files in a directory
  ☆19Updated 9 years ago
• scrapinghub / js2xml
  Convert Javascript code to an XML document
  ☆187Updated 3 years ago
• pudo / dbcopy
  Copy the contents of one SQL database to another
  ☆27Updated 3 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 4 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆79Updated 2 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• CompileInc / hodor
  🕷Configuration based html scraper
  ☆23Updated 7 months ago