Alternatives and similar repositories for urlcanon

Users that are interested in urlcanon are comparing it to the libraries listed below

• internetarchive / surt
  Sort-friendly URI Reordering Transform (SURT) python module
  ☆42Updated 10 months ago
• internetarchive / trough
  Trough: Big data, small databases.
  ☆42Updated 11 months ago
• N0taN3rd / simplechrome
  Webrecorders DevTools Protocol Automation Library
  ☆17Updated 2 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• siznax / khnum
  The god of human readable numbers
  ☆13Updated 5 years ago
• iipc / warc-specifications
  Centralised repository for WARC usage specifications.
  ☆115Updated 7 months ago
• internetarchive / warc
  Python library for reading and writing warc files
  ☆241Updated 3 years ago
• sethmlarson / whatwg-url
  Python implementation of WHATWG URL Living Standard
  ☆21Updated last year
• DocNow / awesome-social-media-archiving
  Tools for helping you work with web platform archive downloads.
  ☆17Updated 5 years ago
• webrecorder / cdxj-indexer
  CDXJ Indexing of WARC/ARCs
  ☆26Updated 6 months ago
• ukwa / ukwa-pywb
  ☆11Updated last year
• webrecorder / wsgiprox
  Python WSGI Middleware for adding HTTP/S proxy support to any WSGI Application
  ☆24Updated 4 years ago
• seomoz / url-py
  URL Transformation, Sanitization
  ☆103Updated last year
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated 3 months ago
• cocrawler / cocrawler
  CoCrawler is a versatile web crawler built using modern tools and concurrency.
  ☆191Updated 3 years ago
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆124Updated 3 months ago
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆69Updated this week
• alard / megawarc
  Nondestructive warc-in-tar to warc conversion
  ☆26Updated 12 years ago
• iipc / webarchive-commons
  Common web archive utility code.
  ☆55Updated last month
• davglass / twimapd
  IMAP server based on Twitter statuses
  ☆55Updated 15 years ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆69Updated 2 weeks ago
• dhamaniasad / WARCTools
  A list of tools related to W(eb)ARC(hive)
  ☆62Updated 10 years ago
• Apoc2400 / Reftag
  Wikipedia citation tool for Google Books, New York Times, ISBN, DOI and more
  ☆22Updated 8 years ago
• microformats / mf2py
  Microformats2 parser written in Python
  ☆106Updated 7 months ago
• oduwsdl / MemGator
  A Memento Aggregator CLI and Server in Go
  ☆65Updated 3 months ago
• dgerber / rfc3987
  Parsing and validation of URIs (RFC 3896) and IRIs (RFC 3987)
  ☆46Updated last year
• unt-libraries / py-wasapi-client
  A client for the Archive-It And Webrecorder WASAPI Data Transfer API
  ☆16Updated 5 years ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆44Updated 4 years ago
• DocNow / waybackprov
  utility to fetch provenance information from Internet Archive's Wayback Machine
  ☆13Updated 3 years ago