Alternatives and similar repositories for urlcanon

Users that are interested in urlcanon are comparing it to the libraries listed below

• internetarchive / surt
  Sort-friendly URI Reordering Transform (SURT) python module
  ☆42Updated 10 months ago
• internetarchive / trough
  Trough: Big data, small databases.
  ☆42Updated 10 months ago
• webrecorder / cdxj-indexer
  CDXJ Indexing of WARC/ARCs
  ☆25Updated 5 months ago
• unt-libraries / py-wasapi-client
  A client for the Archive-It And Webrecorder WASAPI Data Transfer API
  ☆16Updated 5 years ago
• siznax / khnum
  The god of human readable numbers
  ☆13Updated 5 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• internetarchive / warc
  Python library for reading and writing warc files
  ☆240Updated 3 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated 2 months ago
• nla / outbackcdx
  Web archive index server based on RocksDB
  ☆34Updated 3 weeks ago
• ukwa / ukwa-pywb
  ☆11Updated last year
• sethmlarson / whatwg-url
  Python implementation of WHATWG URL Living Standard
  ☆21Updated 11 months ago
• N0taN3rd / simplechrome
  Webrecorders DevTools Protocol Automation Library
  ☆17Updated 2 years ago
• internetarchive / warctools
  Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)
  ☆160Updated this week
• iipc / warc-specifications
  Centralised repository for WARC usage specifications.
  ☆111Updated 6 months ago
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆124Updated 2 months ago
• opensanctions / countrynames
  Utility library to turn country names into ISO two-letter codes
  ☆67Updated last week
• internetarchive / sandcrawler
  Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki
  ☆26Updated 10 months ago
• WASAPI-Community / data-transfer-apis
  WASAPI data transfer APIs
  ☆44Updated 3 years ago
• JeroenDeDauw / Replicator
  CLI tool for importing entities from Wikidata / Wikibase
  ☆23Updated 2 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• DocNow / awesome-social-media-archiving
  Tools for helping you work with web platform archive downloads.
  ☆17Updated 5 years ago
• dgerber / rfc3987
  Parsing and validation of URIs (RFC 3896) and IRIs (RFC 3987)
  ☆46Updated last year
• DocNow / waybackprov
  utility to fetch provenance information from Internet Archive's Wayback Machine
  ☆13Updated 3 years ago
• harvard-lil / waczerciser
  Create and edit WARC and WACZ files
  ☆10Updated 5 months ago
• anjackson / sliver
  A tool for collection archival slivers of the web and web archives
  ☆13Updated 3 months ago
• Apoc2400 / Reftag
  Wikipedia citation tool for Google Books, New York Times, ISBN, DOI and more
  ☆22Updated 8 years ago
• rajbot / CDX-Writer
  Python script to create CDX index files of WARC data
  ☆14Updated 6 years ago
• dhamaniasad / WARCTools
  A list of tools related to W(eb)ARC(hive)
  ☆61Updated 10 years ago
• oduwsdl / MemGator
  A Memento Aggregator CLI and Server in Go
  ☆64Updated 3 months ago
• webrecorder / warcit
  Convert Directories, Files and ZIP Files to Web Archives (WARC)
  ☆85Updated last month