helgeho / Web2Warc

Related projects: ⓘ

• iipc / webarchive-commons
  Common web archive utility code.
  ☆50Updated last week
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆41Updated 6 years ago
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆114Updated last month
• palewire / pastpages.org
  The news homepage archive
  ☆81Updated 2 years ago
• opensemanticsearch / solr-ontology-tagger
  Automatic tagging and analysis of documents in an Apache Solr index for faceted search by RDF(S) Ontologies & SKOS thesauri
  ☆45Updated 2 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆60Updated 4 years ago
• oduwsdl / MemGator
  A Memento Aggregator CLI and Server in Go
  ☆55Updated 3 months ago
• DocNow / unshrtn
  A LevelDB backed URL unshortening microservice written in JavaScript
  ☆31Updated last year
• archivesunleashed / aut
  The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
  ☆137Updated 6 months ago
• iipc / twittervane
  Using social media to steer web archiving and curation.
  ☆15Updated 8 years ago
• ukwa / webarchive-explorer
  Tools for exploring the contents of web archive files.
  ☆39Updated 3 years ago
• gwu-libraries / social-feed-manager
  "Old SFM" -- manage rules and streams from social data sources, starting with twitter.
  ☆87Updated last year
• palewire / storytracker
  Tools for tracking stories on news homepages
  ☆48Updated 4 years ago
• sparkica / dbpedia-extension
  Google Refine extension for adding columns (extending data) from DBpedia
  ☆38Updated 10 years ago
• opensemanticsearch / solr-relevance-ranking-analysis
  Solr Relevance Ranking Analysis and Visualization Tool
  ☆17Updated 4 years ago
• internetarchive / trough
  Trough: Big data, small databases.
  ☆38Updated last month
• WASAPI-Community / data-transfer-apis
  WASAPI data transfer APIs
  ☆42Updated 2 years ago
• nasa-jpl-memex / elwha
  Elwha is a Java application for monitoring topics, sentiment and events on Twitter streams with the ability to generate notification mess…
  ☆14Updated 9 years ago
• internetarchive / surt
  Sort-friendly URI Reordering Transform (SURT) python module
  ☆39Updated last month
• VIDA-NYU / domain_discovery_tool
  This repository contains the Domain Discovery Tool (DDT) project. DDT is an interactive system that helps users explore and better unders…
  ☆46Updated 2 years ago
• helgeho / ArchiveSpark
  An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…
  ☆143Updated this week
• mitre / rhapsode
  Advanced desktop search/corpus exploration prototype
  ☆21Updated 3 years ago
• mkoniari / LegalParser
  This page is a companion for the paper titled Towards Automatic Structuring and Semantic Indexing of Legal Documents
  ☆27Updated 5 years ago
• netarchivesuite / solrwayback
  A search interface and wayback machine for the UKWA Solr based warc-indexer framework.
  ☆100Updated last month
• archivesunleashed / warclight
  A Rails engine supporting the discovery of web archives.
  ☆48Updated last year
• thammegowda / tika-ner-corenlp
  Stanford CoreNLP NER addon for Apache Tika's NamerEntityParser
  ☆13Updated 2 years ago
• lintool / warcbase
  Warcbase is an open-source platform for managing analyzing web archives
  ☆161Updated 6 years ago
• NUKnightLab / twxplorer
  ☆36Updated 10 months ago
• Sotera / newman
  Quickly analyze and explore email with advanced analytics and visualization.
  ☆55Updated 2 years ago
• httpreserve / httpreserve
  Digital Preservation of HTTP in documentary heritage.
  ☆22Updated last year