Alternatives and similar repositories for urlcanon

Users that are interested in urlcanon are comparing it to the libraries listed below

• unt-libraries / py-wasapi-client

  View on GitHub
  A client for the Archive-It And Webrecorder WASAPI Data Transfer API
  ☆16Oct 18, 2019Updated 6 years ago
• oduwsdl / MementoEmbed

  View on GitHub
  A service that provides archive-aware oEmbed-compatible embeddable surrogates (social cards, thumbnails, etc.) for archived web pages (me…
  ☆14Nov 15, 2021Updated 4 years ago
• webrecorder / dat-s3-hybrid-storage

  View on GitHub
  A S3 hybrid storage interface for dat and hyperdrive
  ☆13Jul 31, 2018Updated 7 years ago
• rajbot / CDX-Writer

  View on GitHub
  Python script to create CDX index files of WARC data
  ☆16Sep 7, 2018Updated 7 years ago
• webrecorder / cdxj-indexer

  View on GitHub
  CDXJ Indexing of WARC/ARCs
  ☆32Dec 10, 2024Updated last year
• scrapy / pypydispatcher

  View on GitHub
  A fork of http://pydispatcher.sourceforge.net/ with PyPy support
  ☆16Jul 3, 2017Updated 8 years ago
• web-archive-group / hackathon

  View on GitHub
  ☆14Feb 28, 2017Updated 8 years ago
• DocNow / waybackprov

  View on GitHub
  utility to fetch provenance information from Internet Archive's Wayback Machine
  ☆14Feb 5, 2026Updated last week
• archivesunleashed / graphpass

  View on GitHub
  GraphPass is a utility to filter networks and provide a default visualization output for Gephi or SigmaJS.
  ☆17Nov 14, 2020Updated 5 years ago
• corona10 / mimesniff

  View on GitHub
  Pure python mimesniff implementation of https://mimesniff.spec.whatwg.org
  ☆14Oct 24, 2020Updated 5 years ago
• harvard-lil / js-wacz

  View on GitHub
  JavaScript module and CLI tool for working with web archive data using the WACZ format specification.
  ☆16Mar 11, 2025Updated 11 months ago
• reprozip-news-apps / reprozip-web

  View on GitHub
  ReproZip for the Preservation of Web Applications
  ☆17May 6, 2024Updated last year
• internetarchive / surt

  View on GitHub
  Sort-friendly URI Reordering Transform (SURT) python module
  ☆44Sep 11, 2025Updated 5 months ago
• internetarchive / arch

  View on GitHub
  Web application for distributed compute analysis of Archive-It web archive collections.
  ☆20Oct 9, 2025Updated 4 months ago
• edsu / memento-cli

  View on GitHub
  A command line utility for listing and searching snapshots in web archives
  ☆17Dec 21, 2023Updated 2 years ago
• antiufo / Shaman.Dokan.Warc

  View on GitHub
  Mounts WARC files on Windows
  ☆16Apr 20, 2019Updated 6 years ago
• DocNow / awesome-social-media-archiving

  View on GitHub
  Tools for helping you work with web platform archive downloads.
  ☆18Mar 27, 2020Updated 5 years ago
• N0taN3rd / chrome-remote-interface-extra

  View on GitHub
  Like fs-extra but for the chrome-remote-interface-extra by cyrus-and
  ☆24Aug 12, 2023Updated 2 years ago
• scrapy / scurl

  View on GitHub
  Performance-focused replacement for Python urllib
  ☆21Oct 2, 2018Updated 7 years ago
• UAlbanyArchives / mailbagit

  View on GitHub
  A tool for creating and managing Mailbags, a package for preserving email using multiple preservation formats
  ☆50Nov 24, 2025Updated 2 months ago
• ikreymer / webarchive-indexing

  View on GitHub
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆47Dec 4, 2017Updated 8 years ago
• WASAPI-Community / data-transfer-apis

  View on GitHub
  WASAPI data transfer APIs
  ☆48Apr 23, 2022Updated 3 years ago
• iipc / jwarc

  View on GitHub
  Java library for reading and writing WARC files with a typed API
  ☆54Jan 22, 2026Updated 3 weeks ago
• gwu-libraries / TweetSets

  View on GitHub
  Service for creating Twitter datasets for research and archiving.
  ☆26Dec 7, 2022Updated 3 years ago
• archivesunleashed / notebooks

  View on GitHub
  Various examples of notebooks for working with web archives with the Archives Unleashed Toolkit, and derivatives generated by the Archive…
  ☆26Dec 5, 2022Updated 3 years ago
• eugeneware / warc

  View on GitHub
  Parse WARC (Web Archive Files) as a node.js stream
  ☆23Oct 20, 2014Updated 11 years ago
• oduwsdl / MemGator

  View on GitHub
  A Memento Aggregator CLI and Server in Go
  ☆76Mar 4, 2025Updated 11 months ago
• ArchiveTeam / terroroftinytown-client-grab

  View on GitHub
  The Seesaw pipeline grab script for the URLTeam (terroroftinytown) project
  ☆28Jul 17, 2025Updated 6 months ago
• iipc / webarchive-commons

  View on GitHub
  Common web archive utility code.
  ☆61Feb 6, 2026Updated last week
• nla / outbackcdx

  View on GitHub
  Web archive index server based on RocksDB
  ☆38Feb 1, 2026Updated last week
• webrecorder / warcit

  View on GitHub
  Convert Directories, Files and ZIP Files to Web Archives (WARC)
  ☆92Apr 22, 2025Updated 9 months ago
• NYTEMODEONLY / polyterm

  View on GitHub
  Polymarket in your terminal.
  ☆17Feb 5, 2026Updated last week
• PacktPublishing / Frontend-Web-Development-Bootcamp---Build-a-Twitter-Clone

  View on GitHub
  Code Repository for Frontend Web Development Bootcamp - Build a Twitter Clone, Published by Packt
  ☆12Jan 30, 2023Updated 3 years ago
• webrecorder / express.archiveweb.page

  View on GitHub
  ArchiveWeb.page Express!
  ☆14Nov 1, 2024Updated last year
• ggozad / collective.classification

  View on GitHub
  Content classification/clustering through language processing
  ☆25Mar 10, 2012Updated 13 years ago
• machawk1 / awesome-memento

  View on GitHub
  A list of things related to software, literature, and other content for 🕣 Memento
  ☆105Feb 4, 2026Updated last week
• webrecorder / public-web-archives

  View on GitHub
  A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format
  ☆54Dec 5, 2022Updated 3 years ago
• DrPardosGotor / Screw-Theory-in-Robotics

  View on GitHub
  "Screw Theory for Robotics - MECHANICS - Illustrated" book - Additional Material.
  ☆14Nov 1, 2021Updated 4 years ago
• Xion / taipan

  View on GitHub
  General purpose toolkit for Python
  ☆10Jan 27, 2024Updated 2 years ago