Alternatives and similar repositories for NewsGrabber

Users that are interested in NewsGrabber are comparing it to the libraries listed below

• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• alard / warc-proxy
  Serving content from a WARC
  ☆61Updated 12 years ago
• DocNow / diffengine
  track changes to the news, where news is anything with an RSS feed
  ☆178Updated 4 years ago
• gwu-libraries / social-feed-manager
  "Old SFM" -- manage rules and streams from social data sources, starting with twitter.
  ☆86Updated last year
• ukwa / webarchive-discovery
  WARC and ARC indexing and discovery tools.
  ☆124Updated 2 months ago
• internetarchive / warctools
  Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)
  ☆160Updated 4 years ago
• justinlittman / fbarc
  A commandline tool and Python library for archiving data from Facebook using the Graph API.
  ☆78Updated 7 years ago
• NUKnightLab / twxplorer
  ☆36Updated last year
• palewire / storytracker
  Tools for tracking stories on news homepages
  ☆48Updated 5 years ago
• datatogether / research
  📚 A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity
  ☆95Updated 6 years ago
• chfoo / warcat
  Tool and library for handling Web ARChive (WARC) files.
  ☆159Updated 7 months ago
• gwu-libraries / sfm-ui
  Social Feed Manager user interface application.
  ☆155Updated 11 months ago
• odie5533 / WarcMiddleware
  WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.
  ☆46Updated 7 years ago
• iipc / warc2html
  Converts WARC files to static HTML
  ☆44Updated 11 months ago
• ikreymer / webarchiveplayer
  NOTE: This project is no longer being actively developed.. Check out https://replayweb.page / https://github.com/webrecorder/replayweb.pa…
  ☆201Updated 4 months ago
• bibanon / webcache-scraper
  The Bibliotheca Anonoma's own Bing Cache and Google Cache scraper scripts. Unlike most of the other ones you've seen, these actually work…
  ☆28Updated 7 years ago
• ArchiveTeam / VideoBot
  Specialised bot for periodical grabs and video/audio/etc. webpage scrapes.
  ☆11Updated 7 years ago
• recrm / ArchiveTools
  A collection of tools for archiving and analysing the internet.
  ☆77Updated 2 years ago
• internetarchive / umbra
  A queue-controlled browser automation tool for improving web crawl quality
  ☆61Updated 2 months ago
• thisisparker / linkarchiver
  🗄 Bot powering the @LinkArchiver Twitter tool to send tweeted URLs to the Wayback Machine
  ☆46Updated 7 years ago
• internetarchive / trough
  Trough: Big data, small databases.
  ☆42Updated 10 months ago
• leonardr / cce-python
  Python tools for processing data from the Catalog of Copyright Entries
  ☆37Updated 5 years ago
• machawk1 / awesome-memento
  A list of things related to software, literature, and other content for 🕣 Memento
  ☆98Updated last year
• jplusplus / statscraper
  A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.
  ☆13Updated 3 months ago
• palewire / savepagenow
  A simple Python wrapper and command-line interface for archive.org’s "Save Page Now" capturing service
  ☆179Updated 7 months ago
• peterk / munin-indexer
  A social media open post web archiving tool
  ☆26Updated 3 weeks ago
• oduwsdl / MemGator
  A Memento Aggregator CLI and Server in Go
  ☆64Updated 2 months ago
• dhamaniasad / WARCTools
  A list of tools related to W(eb)ARC(hive)
  ☆61Updated 10 years ago
• JustAnotherArchivist / archivebot-archives
  ☆15Updated 6 years ago
• internetarchive / warc
  Python library for reading and writing warc files
  ☆240Updated 3 years ago