seomoz / url-py

Related projects: ⓘ

• rbaier / python-urltools
  ☆78Updated this week
• stefanw / scrapa
  Python 3 AsyncIO powered scraping framework with batteries included
  ☆20Updated 8 years ago
• scrapy-plugins / scrapy-pagestorage
  A scrapy extension to store requests and responses information in storage service
  ☆26Updated 2 years ago
• redapple / parslepy
  Python implementation of the Parsley language for extracting structured data from web pages
  ☆92Updated 6 years ago
• commonsearch / urlparse4
  Faster replacement for Python's urlparse module
  ☆46Updated 5 years ago
• llonchj / scrapy-sentry
  Sentry component for Scrapy
  ☆86Updated last year
• csalazar / minreq
  ☆20Updated this week
• itamarst / crochet
  Crochet: use Twisted anywhere!
  ☆234Updated 2 weeks ago
• dfm / feedfinder2
  A Python library for finding feed links on websites.
  ☆49Updated 2 years ago
• d0ugal / retrace
  Configurable method retrying for Pythonistas.
  ☆69Updated last year
• scrapy-plugins / scrapy-magicfields
  Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.
  ☆56Updated 2 years ago
• stefano / pyduktape
  Embed the Duktape JS interpreter in Python
  ☆81Updated last year
• Lispython / human_curl
  Simple Human wrapper for cURL library
  ☆205Updated 3 years ago
• scrapinghub / scrapy-mosquitera
  Restrict crawl and scraping scope using matchers.
  ☆25Updated 8 years ago
• nvdv / atq
  distributed task queue for asyncio
  ☆90Updated 6 years ago
• scrapy-plugins / scrapy-monkeylearn
  A Scrapy pipeline to categorize items using MonkeyLearn
  ☆37Updated 7 years ago
• scrapy-plugins / scrapy-splitvariants
  Scrapy spider middleware to split an item into multiple items using a multi-valued key
  ☆20Updated 7 years ago
• jmoiron / speedparser
  feedparser but faster and worse
  ☆101Updated 2 years ago
• Lukasa / httpcache
  Simple HTTP cache for Python Requests
  ☆99Updated 8 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 10 years ago
• aio-libs-abandoned / aioes
  asyncio compatible driver for elasticsearch
  ☆98Updated 5 years ago
• alexk307 / cache_deco
  Backend agnostic cache decorator
  ☆81Updated last year
• Mimino666 / python-xextract
  Extract structured data from HTML and XML documents like a boss.
  ☆50Updated last year
• mitsuhiko / speaklater
  Lazy strings for Python
  ☆61Updated 8 years ago
• codeinthehole / purl
  A simple, immutable URL class with a clean API for interrogation and manipulation.
  ☆294Updated last year
• dgilland / verify
  A painless assertion and validation library for Python.
  ☆66Updated last year
• niksite / url-normalize
  URL normalization for Python
  ☆94Updated 2 years ago
• cypreess / python-rex
  Python Regular Expressions for Humans™.
  ☆231Updated 6 years ago
• seomoz / reppy
  Modern robots.txt Parser for Python
  ☆185Updated 8 months ago
• Defunctionalize / schemagic
  Define the shape of your data with simple python data structures. Use those data descriptions to validate your application.
  ☆43Updated 8 years ago