Alternatives and similar repositories for urlcanon

Users that are interested in urlcanon are comparing it to the libraries listed below

• internetarchive / surt
  Sort-friendly URI Reordering Transform (SURT) python module
  ☆42Updated 11 months ago
• internetarchive / trough
  Trough: Big data, small databases.
  ☆42Updated 11 months ago
• internetarchive / warc
  Python library for reading and writing warc files
  ☆243Updated 3 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• N0taN3rd / simplechrome
  Webrecorders DevTools Protocol Automation Library
  ☆17Updated 2 years ago
• opensanctions / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆70Updated last month
• iipc / warc-specifications
  Centralised repository for WARC usage specifications.
  ☆115Updated 7 months ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated 4 months ago
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆127Updated 2 weeks ago
• peter17 / mediawiki-parser
  An experimental Python parser for MediaWiki syntax with a focus on extensibility and comprehensibility
  ☆61Updated 2 years ago
• DocNow / awesome-social-media-archiving
  Tools for helping you work with web platform archive downloads.
  ☆17Updated 5 years ago
• niksite / url-normalize
  URL normalization for Python
  ☆97Updated 2 months ago
• sethmlarson / whatwg-url
  Python implementation of WHATWG URL Living Standard
  ☆21Updated last year
• seomoz / url-py
  URL Transformation, Sanitization
  ☆103Updated last year
• edsu / dedoop
  recursively deduplicate a directory and write its contents to a new directory while remembering the old paths
  ☆49Updated 4 years ago
• DocNow / diffengine
  track changes to the news, where news is anything with an RSS feed
  ☆178Updated 5 years ago
• edsu / microdata
  python library for extracting html microdata
  ☆166Updated 2 years ago
• webrecorder / har2warc
  Convert HTTP Archive (HAR) -> Web Archive (WARC) format
  ☆52Updated 6 years ago
• AMDmi3 / jsonslicer
  Stream JSON parser for Python
  ☆48Updated 2 years ago
• pykler / yajl-py
  Pure Python wrapper to the Yajl C Library
  ☆83Updated 7 months ago
• kmike / text-unidecode
  The most basic Text::Unidecode port (licensed under Artistic License or GPL or GPLv2+ - choose whatever you want)
  ☆66Updated 2 years ago
• ukwa / ukwa-pywb
  ☆11Updated last year
• pudo / normality
  A tiny library for Python text normalisation. Useful for ad-hoc text processing.
  ☆152Updated 6 months ago
• pudo / banal
  Commons of stupid, simple Python micro functions. Pull requests very welcome.
  ☆19Updated 3 months ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆191Updated 3 years ago
• alvinlindstam / grapheme
  A python package for grapheme aware string handling
  ☆112Updated 3 years ago
• microformats / mf2py
  Microformats2 parser written in Python
  ☆107Updated 8 months ago
• dgerber / rfc3987
  Parsing and validation of URIs (RFC 3896) and IRIs (RFC 3987)
  ☆46Updated last year
• wikimedia / analytics-quarry-web
  Github mirror of "analytics/quarry/web" - our actual code is hosted with Gerrit (please see https://www.mediawiki.org/wiki/Developer_acce…
  ☆43Updated 2 years ago
• DocNow / waybackprov
  utility to fetch provenance information from Internet Archive's Wayback Machine
  ☆13Updated 3 years ago