DocNow / diffengine
track changes to the news, where news is anything with an RSS feed
☆178Updated 4 years ago
Alternatives and similar repositories for diffengine:
Users that are interested in diffengine are comparing it to the libraries listed below
- A simple Python wrapper and command-line interface for archive.org’s "Save Page Now" capturing service☆174Updated 4 months ago
- Code for the twitter bot nyt_diff☆212Updated 2 months ago
- A commandline tool and Python library for archiving data from Facebook using the Graph API.☆77Updated 7 years ago
- WARC and ARC indexing and discovery tools.☆121Updated 6 months ago
- Social Feed Manager user interface application.☆155Updated 7 months ago
- Convert Directories, Files and ZIP Files to Web Archives (WARC)☆84Updated 2 months ago
- Data conversions and examples for generating reports from twarc collections using tools such as D3.js☆55Updated 4 years ago
- Grabbing all news.☆62Updated 5 years ago
- Check out https://github.com/webrecorder/webrecorder for newer version matching https://webrecorder.io☆38Updated 9 years ago
- recursively deduplicate a directory and write its contents to a new directory while remembering the old paths☆48Updated 4 years ago
- Python workers that collect tweets from the twitter streaming api and track deletions☆122Updated 2 years ago
- Monitor stories from news outlets for words or phrases that matter to you☆138Updated this week
- Automatic scraper that tracks changes in news articles over time.☆500Updated 4 years ago
- Internet Research Agency Facebook ads as structured data☆22Updated 5 years ago
- Recover lost websites from the Web Infrastructure☆88Updated 4 years ago
- Twitter, quick. Fetch and store tweets on short notice.☆80Updated 8 years ago
- A list of things related to software, literature, and other content for 🕣 Memento☆94Updated 8 months ago
- Create markov chain ("_ebooks") accounts on Twitter☆59Updated 4 years ago
- (Note: This repository is obsolete, please see the new Browsertrix webrecorder/browsertrix) Browser-Based On-Demand Web Archiving Automat…☆39Updated 5 years ago
- Documentation and project-wide issues for the Website Monitoring project (a.k.a. "Scanner")☆107Updated last month
- "Old SFM" -- manage rules and streams from social data sources, starting with twitter.☆86Updated last year
- Python tools for processing data from the Catalog of Copyright Entries☆37Updated 5 years ago
- Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior System☆88Updated 4 years ago
- Command line tools and libraries for handling and manipulating WARC files (and HTTP contents)☆155Updated 4 years ago
- Tab-delimited versions of Catalog of Copyright Entries renewals☆29Updated 5 years ago
- 🗄 Bot powering the @LinkArchiver Twitter tool to send tweeted URLs to the Wayback Machine☆46Updated 7 years ago
- Tools for tracking stories on news homepages☆48Updated 5 years ago
- 📚 A compilation of research relevant to Data Together's efforts tackling the general problem of data resilience & interactivity☆96Updated 6 years ago
- Run Overview on your own system☆123Updated 3 years ago
- Materials to reproduce findings in our story, "Google’s Top Search Result? Surprise! It’s Google"☆34Updated 4 years ago