Alternatives and similar repositories for awesome-web-scraping:

Users that are interested in awesome-web-scraping are comparing it to the libraries listed below

• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• scrapinghub / scrapy-mosquitera
  Restrict crawl and scraping scope using matchers.
  ☆25Updated 8 years ago
• D3xterjs / pydexter
  Simple plotting for Python. Python wrapper for D3xter - render charts in the browser with simple Python syntax.
  ☆31Updated 6 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 3 years ago
• wearpants / instrument
  Python observability & instrumentation primitives for metrics and benchmarking
  ☆12Updated 6 years ago
• CompileInc / hodor
  🕷Configuration based html scraper
  ☆23Updated last month
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• adonisnafeh / iconf
  Simple method used to load configuration variables from different sources.
  ☆10Updated 6 years ago
• MartinPaulEve / PlotSummary
  Plots various graphs for a series of plaintext files in a directory
  ☆19Updated 8 years ago
• stummjr / flake8-scrapy
  A Flake8 plugin to catch common issues on Scrapy spiders
  ☆19Updated 3 years ago
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• scrapinghub / autopager
  Detect and classify pagination links
  ☆15Updated 4 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆13Updated last year
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 4 years ago
• spurin / xmldataset
  xmldataset: xml parsing made easy 🗃️
  ☆78Updated 4 years ago
• cypreess / python-rex
  Python Regular Expressions for Humans™.
  ☆229Updated 7 years ago
• christabor / flask_extras
  Assorted generic flask views, blueprints, Jinja2 filters, macros, forms and more.
  ☆24Updated 5 years ago
• hchasestevens / tracing
  Utilities for tracing program execution line-by-line
  ☆33Updated 7 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 11 months ago
• idlesign / envbox
  Detect environment type and work within.
  ☆25Updated 2 years ago
• cjoeml / Relatively-Sized-Progress-Bar
  Creates a progress bar that is sized dynamically to the current terminal window size.
  ☆9Updated 6 years ago
• tasdikrahman / pyzipcode-cli
  Extract all possible meta data using Zipcode
  ☆35Updated 5 years ago
• catherinedevlin / python_learners_glossary
  Definitions of Pardon jargon to help Python beginners understand Pythonista gobbletigook
  ☆54Updated 5 years ago
• pawamoy / django-meerkat
  Security audit tool for Django sites
  ☆14Updated 6 months ago
• ardydedase / apiwrapper
  API Wrapper in Python with polling and request callbacks.
  ☆40Updated 10 months ago
• aniketmaithani / py-must-read
  Must-read articles and books about Python. Inspired by https://github.com/s16h/py-must-watch
  ☆11Updated 8 years ago
• rmax / databrewer
  The missing datasets manager. Like hombrew but for datasets. CLI-tool for search and discover datasets!
  ☆39Updated 7 years ago
• opensanctions / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆66Updated 2 months ago