Alternatives and similar repositories for scurl:

Users that are interested in scurl are comparing it to the libraries listed below

• scrapy / pypydispatcher
  A fork of http://pydispatcher.sourceforge.net/ with PyPy support
  ☆16Updated 7 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• scrapy-plugins / scrapy-streaming
  ☆18Updated 8 years ago
• TeamHG-Memex / scrapy-crawl-once
  Scrapy middleware which allows to crawl only new content
  ☆80Updated 2 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆14Updated last year
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆45Updated 3 years ago
• pyca / service-identity
  Service Identity Verification for Python
  ☆104Updated last week
• teddziuba / pqauth
  Web API Authentication with SSH Public Keys
  ☆161Updated 11 years ago
• scrapinghub / andi
  Library for annotation-based dependency injection
  ☆22Updated 2 weeks ago
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆58Updated 2 weeks ago
• twisted / constantly
  Symbolic Constants in Python
  ☆23Updated 5 months ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• barseghyanartur / radar
  Generate random date(time) in Python.
  ☆10Updated 11 months ago
• jaysw / ipydb
  Turn your IPython console into a cross-database SQL client
  ☆31Updated 8 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• scrapy / itemloaders
  Library to populate items using XPath and CSS with a convenient API
  ☆46Updated 2 weeks ago
• rmax / scrapy-boilerplate
  Small set of utilities to simplify writing Scrapy spiders.
  ☆49Updated 9 years ago
• thombashi / typepy
  A Python library for variable type checker/validator/converter at a run time.
  ☆16Updated last month
• opentracing / basictracer-python
  The Python implementation of the "BasicTracer" reference implementation. 🛑 This library is DEPRECATED!
  ☆26Updated last year
• drdrsh / vc-crypt
  A simple python script with zero dependencies that can be used to encrypt/decrypt secret credentials (API secret keys, HTTP passwords, et…
  ☆14Updated 7 years ago
• TeamHG-Memex / autologin-middleware
  Scrapy middleware for the autologin
  ☆37Updated 6 years ago
• scrapy-plugins / scrapy-splitvariants
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆20Updated 8 years ago
• scrapy / scrapy-bench
  A CLI for benchmarking Scrapy.
  ☆31Updated 3 years ago
• uber / py-look-for-timeouts
  Scan for missing timeout calls in python source files
  ☆18Updated 4 years ago
• erberlin / pywol
  A Wake-on-LAN tool written in Python.
  ☆36Updated 5 years ago
• scrapinghub / scrapy-mosquitera
  Restrict crawl and scraping scope using matchers.
  ☆25Updated 8 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆96Updated last week
• stummjr / flake8-scrapy
  A Flake8 plugin to catch common issues on Scrapy spiders
  ☆19Updated 2 years ago
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• scrapinghub / docker-images
  ☆32Updated last year