Alternatives and similar repositories for awesome-web-scraping:

Users that are interested in awesome-web-scraping are comparing it to the libraries listed below

• stummjr / flake8-scrapy
  A Flake8 plugin to catch common issues on Scrapy spiders
  ☆19Updated 2 years ago
• scrapinghub / scrapy-mosquitera
  Restrict crawl and scraping scope using matchers.
  ☆25Updated 8 years ago
• pawamoy / django-meerkat
  Security audit tool for Django sites
  ☆14Updated 3 months ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆14Updated last year
• scrapy-plugins / scrapy-monkeylearn
  A Scrapy pipeline to categorize items using MonkeyLearn
  ☆37Updated 7 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• svetlyak40wt / python-processor
  A command line replacement for zapier and ifttt.
  ☆39Updated 6 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• kaflesudip / grabfeed
  Python package to detect and return RSS / Atom feeds for a given website. The tool supports major blogging platform including Wordpress, …
  ☆21Updated 3 years ago
• povilasb / scrapy-html-storage
  Scrapy downloader middleware that stores response HTMLs to disk.
  ☆19Updated 8 months ago
• littlecolumns / little-geocoder
  A tool to allow US addresses to be geocoded/georeferenced easily, without using Python or the command line or paid services or anything.
  ☆17Updated 2 years ago
• catherinedevlin / python_learners_glossary
  Definitions of Pardon jargon to help Python beginners understand Pythonista gobbletigook
  ☆53Updated 4 years ago
• okfn / vdm
  Versioned domain model. Python library for revisioning/versioning of databases.
  ☆44Updated 4 years ago
• kodiaklabs / MovieSentimentClassification
  A brief tutorial on NLP via sentiment classification, Jupyter notebooks, feature creation, and exploritory data analysis.
  ☆25Updated 6 years ago
• Prooffreader / word_list_tools
  Python and pandas tools to perform various analyses on different types of word lists
  ☆16Updated 10 years ago
• MartinPaulEve / PlotSummary
  Plots various graphs for a series of plaintext files in a directory
  ☆19Updated 8 years ago
• scrapinghub / arche
  Analyze scraped data
  ☆47Updated 5 years ago
• spurin / xmldataset
  xmldataset: xml parsing made easy 🗃️
  ☆78Updated 4 years ago
• sethmlarson / pypi-scorecards
  OpenSSF Scorecard for top Python packages
  ☆16Updated this week
• Parsely / birding
  Stream processing in Python of twitter searches using public APIs.
  ☆9Updated 9 years ago
• jobcli / jobcli-app
  Command Line Application for Job Search
  ☆13Updated 7 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 8 months ago
• prospector-dev / requirements-detector
  ☆49Updated 3 weeks ago
• tonysyu / logquacious
  Logquacious is a set of simple logging utilities to help you over-communicate.
  ☆33Updated 5 years ago
• dssg / pgdedupe
  A simple command line interface to the datamade/dedupe library.
  ☆42Updated 2 years ago
• omab / psa-passwordless
  Passwordless Email Auth
  ☆26Updated 2 years ago
• Psycojoker / ipython-beautifulsoup
  Pretty HTML/XML rendering with syntax highlighting for BeautifulSoup objects in IPython notebook and qtconsole.
  ☆69Updated 4 years ago
• pythad / selenium_extensions
  Tools that will make writing tests, bots and scrapers using Selenium much easier
  ☆140Updated last month
• opensanctions / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆66Updated this week