Alternatives and similar repositories for webarchive-indexing

Users that are interested in webarchive-indexing are comparing it to the libraries listed below

• unt-libraries / py-wasapi-client

  View on GitHub
  A client for the Archive-It And Webrecorder WASAPI Data Transfer API
  ☆16Oct 18, 2019Updated 6 years ago
• edsu / memento-cli

  View on GitHub
  A command line utility for listing and searching snapshots in web archives
  ☆17Dec 21, 2023Updated 2 years ago
• ukwa / ukwa-pywb

  View on GitHub
  ☆11Nov 21, 2025Updated 2 months ago
• NationalLibraryOfNorway / warchaeology

  View on GitHub
  Command line tool for digging into WARC files
  ☆50Jan 30, 2026Updated 2 weeks ago
• ikreymer / browsertrix

  View on GitHub
  (Note: This repository is obsolete, please see the new Browsertrix webrecorder/browsertrix) Browser-Based On-Demand Web Archiving Automat…
  ☆38Apr 23, 2019Updated 6 years ago
• nlnwa / gowarcserver

  View on GitHub
  ☆17Mar 31, 2025Updated 10 months ago
• iipc / webarchive-commons

  View on GitHub
  Common web archive utility code.
  ☆61Feb 6, 2026Updated last week
• nla / outbackcdx

  View on GitHub
  Web archive index server based on RocksDB
  ☆38Feb 1, 2026Updated 2 weeks ago
• harvard-lil / waczerciser

  View on GitHub
  Create and edit WARC and WACZ files
  ☆24Dec 6, 2024Updated last year
• webrecorder / cdxj-indexer

  View on GitHub
  CDXJ Indexing of WARC/ARCs
  ☆32Dec 10, 2024Updated last year
• webrecorder / express.archiveweb.page

  View on GitHub
  ArchiveWeb.page Express!
  ☆14Nov 1, 2024Updated last year
• webrecorder / har2warc

  View on GitHub
  Convert HTTP Archive (HAR) -> Web Archive (WARC) format
  ☆56Oct 21, 2018Updated 7 years ago
• UAlbanyArchives / describingWebArchives

  View on GitHub
  Automating description for Web Archives in ArchivesSpace using the Archive-It CDX and Partner Data APIs
  ☆11Aug 10, 2018Updated 7 years ago
• webrecorder / dat-share

  View on GitHub
  A prototype server to swarm multiple DATs for Webrecorder
  ☆14Apr 27, 2019Updated 6 years ago
• barentsen / tweet-tracking

  View on GitHub
  Scripts for data mining Twitter
  ☆11Apr 3, 2016Updated 9 years ago
• archivesunleashed / auk

  View on GitHub
  Rails application for the Archives Unleashed Cloud.
  ☆11Jun 30, 2021Updated 4 years ago
• vphill / web-archiving-course

  View on GitHub
  Web Archiving Course
  ☆23Mar 4, 2024Updated last year
• webrecorder / browsertrix-old

  View on GitHub
  Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior System
  ☆87Feb 16, 2021Updated 5 years ago
• WASAPI-Community / data-transfer-apis

  View on GitHub
  WASAPI data transfer APIs
  ☆48Apr 23, 2022Updated 3 years ago
• ukwa / webarchive-discovery

  View on GitHub
  Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…
  ☆132Nov 21, 2025Updated 2 months ago
• iipc / warc2html

  View on GitHub
  Converts WARC files to static HTML
  ☆51Sep 18, 2025Updated 4 months ago
• internetarchive / surt

  View on GitHub
  Sort-friendly URI Reordering Transform (SURT) python module
  ☆44Sep 11, 2025Updated 5 months ago
• webrecorder / markdown-to-respec

  View on GitHub
  A Github Action for turning Markdown into ReSpec HTML
  ☆15Jun 6, 2024Updated last year
• harvard-lil / WARC-diff-tools

  View on GitHub
  Comparing warc files
  ☆17Feb 21, 2019Updated 6 years ago
• harvard-lil / js-wacz

  View on GitHub
  JavaScript module and CLI tool for working with web archive data using the WACZ format specification.
  ☆16Mar 11, 2025Updated 11 months ago
• webrecorder / public-web-archives

  View on GitHub
  A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format
  ☆54Dec 5, 2022Updated 3 years ago
• netarchivesuite / solrwayback

  View on GitHub
  A search interface and wayback machine for the UKWA Solr based warc-indexer framework.
  ☆134Feb 3, 2026Updated last week
• anjackson / sliver

  View on GitHub
  A tool for collection archival slivers of the web and web archives
  ☆17Feb 18, 2025Updated 11 months ago
• datatogether / warc

  View on GitHub
  Golang WARC (Web ARChive) Library
  ☆30Aug 6, 2019Updated 6 years ago
• justinlittman / fbarc

  View on GitHub
  A commandline tool and Python library for archiving data from Facebook using the Graph API.
  ☆78Jan 29, 2018Updated 8 years ago
• harvard-lil / wacz-exhibitor

  View on GitHub
  Experimental proxy and wrapper for safely embedding Web Archives (warc, warc.gz, wacz) into web pages.
  ☆39Nov 24, 2025Updated 2 months ago
• vinaygoel / ars-workshop

  View on GitHub
  Archive Research Services Workshop
  ☆31Sep 29, 2017Updated 8 years ago
• ukwa / shine

  View on GitHub
  Prototype SOLR-powered web archive exploration UI.
  ☆43Jun 3, 2020Updated 5 years ago
• webrecorder / wsgiprox

  View on GitHub
  Python WSGI Middleware for adding HTTP/S proxy support to any WSGI Application
  ☆24Oct 27, 2020Updated 5 years ago
• harvard-lil / warcgames

  View on GitHub
  Hacking challenges to learn web archive security.
  ☆35Jun 23, 2017Updated 8 years ago
• mjordan / GitBags

  View on GitHub
  Some ideas on making Bags into Git repositories
  ☆16Dec 23, 2014Updated 11 years ago
• odie5533 / WarcMiddleware

  View on GitHub
  WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.
  ☆48Mar 19, 2018Updated 7 years ago
• rossf7 / wikireverse

  View on GitHub
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Aug 12, 2018Updated 7 years ago
• archivesunleashed / aut

  View on GitHub
  The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
  ☆153Dec 5, 2025Updated 2 months ago