Alternatives and similar repositories for awesome-web-scraping

Users that are interested in awesome-web-scraping are comparing it to the libraries listed below

• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 7 years ago
• scrapy / flake8-scrapy
  A Flake8 plugin to catch common issues in Scrapy projects.
  ☆20Updated this week
• scrapinghub / scrapy-mosquitera
  Restrict crawl and scraping scope using matchers.
  ☆25Updated 9 years ago
• okfn / vdm
  Versioned domain model. Python library for revisioning/versioning of databases.
  ☆44Updated 4 years ago
• danvk / pyjsonselect
  Fully conformant implementation of JSONSelect in Python
  ☆12Updated 10 years ago
• prospector-dev / requirements-detector
  ☆49Updated last week
• samuelcolvin / grablib
  Static asset management in python
  ☆20Updated last year
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 3 years ago
• erberlin / namedzip
  Extends zip() and itertools.zip_longest() to generate named tuples.
  ☆22Updated 6 years ago
• D3xterjs / pydexter
  Simple plotting for Python. Python wrapper for D3xter - render charts in the browser with simple Python syntax.
  ☆31Updated 7 years ago
• pawamoy / django-meerkat
  Security audit tool for Django sites
  ☆14Updated 2 weeks ago
• scrapy-plugins / scrapy-splitvariants
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆20Updated 8 years ago
• commonsearch / urlparse4
  Faster replacement for Python's urlparse module
  ☆46Updated 6 years ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• induane / logcolor
  Formatter allowing for colored output in log messages
  ☆49Updated last month
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• CompileInc / hodor
  🕷Configuration based html scraper
  ☆23Updated 3 months ago
• pydanny / contributors
  A command-line script to get all the contributors for one or more GitHub projects.
  ☆33Updated 3 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆13Updated last year
• mdipierro / autoinstaller
  ☆104Updated 9 years ago
• psf / community-code-of-conduct
  The Python Software Foundation Community Code of Conduct
  ☆19Updated last year
• catherinedevlin / python_learners_glossary
  Definitions of Pardon jargon to help Python beginners understand Pythonista gobbletigook
  ☆54Updated 5 years ago
• ueg1990 / faker-schema
  Generate fake data using joke2k's faker and your own schema
  ☆94Updated 4 years ago
• heynemann / octopus
  octopus is a library to concurrently retrieve and report on the completion of http requests.
  ☆23Updated 7 years ago
• sloria / ped
  Quickly open Python modules in your text editor
  ☆45Updated last week
• adonisnafeh / iconf
  Simple method used to load configuration variables from different sources.
  ☆10Updated 7 years ago
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• migrateup / fakepandas
  Rebellious Magic Methods Demo
  ☆14Updated 8 years ago
• mahmoud / espymetrics
  EspyMetrics is a pure-Python analytics service that tracks Python usage. It is the reference project for Enterprise Software with Python.
  ☆52Updated 5 years ago
• pudo-attic / jsonmapping
  Transform flat data structures into nested object graphs matching JSON schema definitions.
  ☆28Updated 8 years ago