Alternatives and similar repositories for NewsGrabber

Users that are interested in NewsGrabber are comparing it to the libraries listed below

• chfoo / warcat
  Tool and library for handling Web ARChive (WARC) files.
  ☆159Updated 8 months ago
• alard / warc-proxy
  Serving content from a WARC
  ☆61Updated 12 years ago
• internetarchive / warctools
  Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)
  ☆161Updated 3 weeks ago
• recrm / ArchiveTools
  A collection of tools for archiving and analysing the internet.
  ☆77Updated 2 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• DocNow / diffengine
  track changes to the news, where news is anything with an RSS feed
  ☆178Updated 4 years ago
• gwu-libraries / sfm-ui
  Social Feed Manager user interface application.
  ☆155Updated 11 months ago
• odie5533 / WarcMiddleware
  WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.
  ☆46Updated 7 years ago
• machawk1 / awesome-memento
  A list of things related to software, literature, and other content for 🕣 Memento
  ☆99Updated last year
• JustAnotherArchivist / archivebot-archives
  ☆15Updated 6 years ago
• jplusplus / statscraper
  A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.
  ☆13Updated 3 months ago
• ikreymer / webarchiveplayer
  NOTE: This project is no longer being actively developed.. Check out https://replayweb.page / https://github.com/webrecorder/replayweb.pa…
  ☆201Updated 5 months ago
• minimaxir / reddit-graph
  Jupyter notebook + Code for reproducing Reddit Subreddit graphs
  ☆17Updated 9 years ago
• gwu-libraries / social-feed-manager
  "Old SFM" -- manage rules and streams from social data sources, starting with twitter.
  ☆86Updated last year
• ikreymer / pywb-webrecorder
  Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io
  ☆38Updated 9 years ago
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆124Updated 3 months ago
• dhamaniasad / WARCTools
  A list of tools related to W(eb)ARC(hive)
  ☆62Updated 10 years ago
• ArchiveTeam / NewsGrabber-Warrior
  ☆8Updated 5 years ago
• ArchiveTeam / VideoBot
  Specialised bot for periodical grabs and video/audio/etc. webpage scrapes.
  ☆11Updated 7 years ago
• N0taN3rd / Squidwarc
  Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head
  ☆170Updated 5 years ago
• webrecorder / browsertrix-old
  Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior System
  ☆87Updated 4 years ago
• webrecorder / warcit
  Convert Directories, Files and ZIP Files to Web Archives (WARC)
  ☆85Updated 2 months ago
• fitnr / twitter_bot_utils
  Python utilities to make it a little easier to set up and run a Twitter bot
  ☆40Updated 2 years ago
• sangaline / scrapy-wayback-machine
  A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
  ☆115Updated last year
• NUKnightLab / twxplorer
  ☆36Updated last year
• palewire / storytracker
  Tools for tracking stories on news homepages
  ☆48Updated 5 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• oduwsdl / MemGator
  A Memento Aggregator CLI and Server in Go
  ☆65Updated 3 months ago
• palewire / savepagenow
  A simple Python wrapper and command-line interface for archive.org’s "Save Page Now" capturing service
  ☆180Updated 8 months ago
• Famicoman / ia-collection-dl
  Downloads an entire Internet Archive collection
  ☆33Updated 6 years ago