Alternatives and similar repositories for awesome-web-scraping

Users that are interested in awesome-web-scraping are comparing it to the libraries listed below

• povilasb / scrapy-html-storage
  Scrapy downloader middleware that stores response HTMLs to disk.
  ☆18Updated 4 months ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 8 years ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 4 years ago
• scrapinghub / js2xml
  Convert Javascript code to an XML document
  ☆187Updated 3 years ago
• dssg / pgdedupe
  A simple command line interface to the datamade/dedupe library.
  ☆42Updated 2 years ago
• rochacbruno-archive / scrapy_model
  A helper to create web scrapers using scrapy selector in a Model based structure
  ☆57Updated 2 years ago
• opensanctions / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆71Updated 4 months ago
• pudo-attic / scrapekit
  Python library with common functionality for writing web scrapers
  ☆102Updated 10 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• pythad / selenium_extensions
  Tools that will make writing tests, bots and scrapers using Selenium much easier
  ☆139Updated last year
• scrapinghub / skinfer
  Skinfer is a tool for inferring and merging JSON schemas
  ☆141Updated last year
• geowurster / NewlineJSON
  Streaming newline delimited JSON I/O.
  ☆12Updated 2 years ago
• pudo / normality
  A tiny library for Python text normalisation. Useful for ad-hoc text processing.
  ☆157Updated 3 months ago
• svetlyak40wt / python-processor
  A command line replacement for zapier and ifttt.
  ☆39Updated 7 years ago
• D3xterjs / pydexter
  Simple plotting for Python. Python wrapper for D3xter - render charts in the browser with simple Python syntax.
  ☆31Updated 7 years ago
• sachin-philip / beautifier
  Simple library to cleanup and prettify url patterns and emails
  ☆137Updated 3 years ago
• lethain / extraction
  A Python library for extracting titles, images, descriptions and canonical urls from HTML.
  ☆151Updated 5 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• di / vladiate
  A strict validation tool for CSV files
  ☆93Updated 3 months ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 7 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• mynameisvinn / EmailParser
  remove signature blocks from emails
  ☆87Updated 6 years ago
• frictionlessdata / tableschema-pandas-py
  Generate Pandas frames, load and extract data, based on JSON Table Schema descriptors.
  ☆52Updated 4 years ago
• TeamHG-Memex / scrapy-dockerhub
  [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.
  ☆11Updated 10 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆103Updated 2 weeks ago
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆205Updated 2 months ago
• sihaelov / harser
  Easy way for HTML parsing and building XPath
  ☆135Updated 3 years ago
• ondergetekende / livescrape
  A toolkit to build pythonic web scraper libraries
  ☆40Updated 8 years ago
• CompileInc / hodor
  🕷Configuration based html scraper
  ☆23Updated last month
• pferate / meetup-api
  Python API for Meetup
  ☆43Updated 6 years ago