Alternatives and similar repositories for libwarc

Users that are interested in libwarc are comparing it to the libraries listed below

• themains / rdomains
  Classifying the content of domains
  ☆56Updated 2 years ago
• internetarchive / pdf_trio
  A PDF classifier ensemble with REST API service
  ☆23Updated 4 years ago
• pdfliberation / knowledge
  A place to collect and share knowledge about liberating data from PDFs
  ☆54Updated 3 years ago
• hrbrmstr / gdns
  Tools to work with the Google DNS over HTTPS API in R
  ☆25Updated 5 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• helgeho / Web2Warc
  An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
  ☆25Updated 7 years ago
• inferlink / landmark-extractor
  ☆11Updated 6 years ago
• cantabular / databaker
  Command line tool to convert spreadsheets to databases, made for the UK's Office for National Statistics.
  ☆80Updated last year
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 4 years ago
• wouterdewinter / deep-hive
  Using your audience as a hive mind for deep learning
  ☆18Updated 6 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated 4 months ago
• oduwsdl / MementoEmbed
  A service that provides archive-aware oEmbed-compatible embeddable surrogates (social cards, thumbnails, etc.) for archived web pages (me…
  ☆14Updated 3 years ago
• internetarchive / trough
  Trough: Big data, small databases.
  ☆42Updated last year
• WICI / fastviz
  Fast filtering and animation of large dynamic networks
  ☆39Updated 9 years ago
• veltman / endorsements
  Data on newspaper presidential endorsements
  ☆30Updated 4 years ago
• xkxx / algodb
  Mad (╯°□°)╯'ing
  ☆10Updated 2 years ago
• weblyzard / graphyte
  JavaScript based graph visualization library with emphasis on customization and modularity.
  ☆13Updated 6 years ago
• niczem / trawler
  scraper for facebook, gab, google and tiktok
  ☆21Updated last month
• datamade / dossier
  Machine assisted dossiers
  ☆19Updated 7 years ago
• zsavvas / trolls_analysis
  Source code that reproduces the results from the paper "Who Let The Trolls Out? Towards Understanding State-Sponsored Trolls" (https://ar…
  ☆20Updated 6 years ago
• mkearney / trumptweets
  Download data on all of Donald Trump's (@realDonaldTrump) tweets
  ☆42Updated 6 years ago
• Early-Modern-OCR / hOCR-De-Noising
  code to remove "noise" from hOCR output of Tesseract OCR.
  ☆14Updated 8 years ago
• montera34 / pageonex
  PageOneX. Analyzing front pages
  ☆52Updated 8 months ago
• Code4SA / mma-dexter
  Dexter document monitor for MMA
  ☆17Updated last year
• bpb27 / political_twitter_archive
  twitter archives of political figures
  ☆81Updated 8 years ago
• themains / virustotal
  R client for the Virustotal Public API. Virustotal is a Google service that analyzes files and URLs for viruses etc.
  ☆12Updated 2 years ago
• earino / fast_sample
  A script for rapidly sampling a proportion of lines from a file
  ☆19Updated 10 years ago
• Big-Ancient-Mediterranean / BAM
  A tool for the geospatial analysis, literary network visualization, and plot mapping of ancient texts
  ☆14Updated 6 years ago
• mattwaite / JOUR491-Storybots
  A repository of materials for a proposed class on automated story bots.
  ☆49Updated 6 years ago