DocNow / diffengineLinks
track changes to the news, where news is anything with an RSS feed
☆179Updated 5 years ago
Alternatives and similar repositories for diffengine
Users that are interested in diffengine are comparing it to the libraries listed below
Sorting:
- Social Feed Manager user interface application.☆156Updated last year
- A commandline tool and Python library for archiving data from Facebook using the Graph API.☆79Updated 7 years ago
- Documentation and project-wide issues for the Website Monitoring project (a.k.a. "Scanner")☆108Updated 6 months ago
- Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in t…☆128Updated 3 weeks ago
- Automatic scraper that tracks changes in news articles over time.☆501Updated 4 years ago
- Python workers that collect tweets from the twitter streaming api and track deletions☆128Updated 2 years ago
- Grabbing all news.☆62Updated 5 years ago
- A LevelDB backed URL unshortening microservice written in JavaScript☆31Updated 2 years ago
- (Note: This repository is obsolete, please see the new Browsertrix webrecorder/browsertrix) Browser-Based On-Demand Web Archiving Automat…☆39Updated 6 years ago
- Monitor stories from news outlets for words or phrases that matter to you☆150Updated 5 months ago
- framework for scraping legislative/government data☆86Updated 11 months ago
- Data conversions and examples for generating reports from twarc collections using tools such as D3.js☆54Updated 5 years ago
- "Old SFM" -- manage rules and streams from social data sources, starting with twitter.☆86Updated 2 years ago
- Python library for reading and writing warc files☆244Updated 3 years ago
- A simple Python wrapper and command-line interface for archive.org’s "Save Page Now" capturing service☆181Updated 10 months ago
- Code for the twitter bot nyt_diff☆213Updated 8 months ago
- 🗄 Bot powering the @LinkArchiver Twitter tool to send tweeted URLs to the Wayback Machine☆46Updated 7 years ago
- An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed…☆152Updated 3 weeks ago
- Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io☆38Updated 9 years ago
- Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior System☆87Updated 4 years ago
- Tools for tracking stories on news homepages☆48Updated 5 years ago
- Twitter, quick. Fetch and store tweets on short notice.☆79Updated 8 years ago
- Trough: Big data, small databases.☆42Updated last year
- A suite of focused and simple tools and activities for journalists, data journalism classrooms and community advocacy groups☆63Updated last year
- Enhanced Social Tagging for Academic Communities☆97Updated 10 months ago
- Sort-friendly URI Reordering Transform (SURT) python module☆42Updated last year
- The basic code behind the @big_cases Twitter bot☆106Updated 5 years ago
- recursively deduplicate a directory and write its contents to a new directory while remembering the old paths☆49Updated 4 years ago
- The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.☆145Updated last year
- Internet Research Agency Facebook ads as structured data☆22Updated 5 years ago