ukwa / webarchive-explorer

Related projects ⓘ

Alternatives and complementary repositories for webarchive-explorer

• iipc / webarchive-commons
  Common web archive utility code.
  ☆50Updated last month
• helgeho / Web2Warc
  An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
  ☆24Updated 7 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆42Updated 6 years ago
• iipc / warc-specifications
  Centralised repository for WARC usage specifications.
  ☆100Updated this week
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆60Updated 4 years ago
• alard / warc-proxy
  Serving content from a WARC
  ☆60Updated 11 years ago
• fcrepo-exts / fcrepo-webapp-plus
  Fcrepo4 webapp plus optional fcrepo dependencies
  ☆13Updated 4 years ago
• nla / outbackcdx
  Web archive index server based on RocksDB
  ☆32Updated this week
• vinaygoel / archive-analysis
  Tools to analyze web archives
  ☆20Updated 8 years ago
• iipc / jwarc
  Java library for reading and writing WARC files with a typed API
  ☆48Updated this week
• internetarchive / surt
  Sort-friendly URI Reordering Transform (SURT) python module
  ☆40Updated 3 months ago
• ukwa / shine
  Prototype SOLR-powered web archive exploration UI.
  ☆43Updated 4 years ago
• mkalus / segrada
  Segrada - Semantic Graph Database
  ☆68Updated last year
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆117Updated 3 months ago
• archivesunleashed / aut
  The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
  ☆137Updated 8 months ago
• iipc / twittervane
  Using social media to steer web archiving and curation.
  ☆15Updated 9 years ago
• internetarchive / sandcrawler
  Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki
  ☆25Updated 3 months ago
• WASAPI-Community / data-transfer-apis
  WASAPI data transfer APIs
  ☆42Updated 2 years ago
• archivesunleashed / warclight
  A Rails engine supporting the discovery of web archives.
  ☆49Updated last year
• webrecorder / cdxj-indexer
  CDXJ Indexing of WARC/ARCs
  ☆21Updated last week
• oduwsdl / MemGator
  A Memento Aggregator CLI and Server in Go
  ☆57Updated 6 months ago
• internetarchive / trough
  Trough: Big data, small databases.
  ☆40Updated 3 months ago
• archivesunleashed / docker-aut
  Docker image for the Archives Unleashed Toolkit
  ☆12Updated 2 years ago
• gwu-libraries / social-feed-manager
  "Old SFM" -- manage rules and streams from social data sources, starting with twitter.
  ☆87Updated last year
• lintool / warcbase
  Warcbase is an open-source platform for managing analyzing web archives
  ☆162Updated 6 years ago
• reconciliation-api / specs
  Specifications of the reconciliation API
  ☆33Updated last week
• webrecorder / warcit
  Convert Directories, Files and ZIP Files to Web Archives (WARC)
  ☆81Updated last week
• Georgetown-University-Libraries / File-Analyzer
  A Data Parsing/Data Manipulation Tool Supporting Digitization Projects and Other Data Analysis Projects
  ☆47Updated 5 years ago
• Libraccess / docs
  Documents for the project Libraccess
  ☆13Updated 9 years ago