bibanon / webcache-scraper
The Bibliotheca Anonoma's own Bing Cache and Google Cache scraper scripts. Unlike most of the other ones you've seen, these actually work.
☆28Updated 7 years ago
Alternatives and similar repositories for webcache-scraper:
Users that are interested in webcache-scraper are comparing it to the libraries listed below
- Grabbing all news.☆62Updated 5 years ago
- Script to import youtube-dl metadata to PostgreSQL☆14Updated 6 years ago
- Easily archive important Reddit post threads onto your computer☆59Updated 2 years ago
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user ac…☆52Updated last month
- Nondestructive warc-in-tar to warc conversion☆26Updated 11 years ago
- 💾 YouTube video metadata archiver written in Golang☆19Updated 5 years ago
- Recover lost websites from the Web Infrastructure☆88Updated 4 years ago
- Serving content from a WARC☆61Updated 12 years ago
- An in-progress collection of sites that spread clickbait, hoaxes, propaganda and disinformation.☆99Updated last year
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆44Updated 7 years ago
- Easily archive important Reddit post threads onto your computer☆61Updated 2 years ago
- Web archiving using Google Chrome☆44Updated 5 years ago
- Bot for operating snscrape in #archivebot on efnet☆10Updated 5 years ago
- Removes evil URL parameters such as Google Analytics' utm parameters☆19Updated 7 years ago
- dosage is a comic strip downloader and archiver☆51Updated 5 years ago
- A site for finding untagged Tumblr posts☆25Updated 3 years ago
- A tool that helps with analysis of obfuscated JavaScript☆11Updated last year
- data with similar subreddits graph☆45Updated last year
- Simple IPFS-based file sharing, modified from pomf.se (RIP in pieces)☆10Updated 7 years ago
- scraper for facebook, gab, google and tiktok☆22Updated 8 months ago
- Django port of the Google App Engine rsstodolist application☆16Updated 3 years ago
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆51Updated 6 years ago
- Basic python script to list following and followed blogs on Tumblr☆19Updated 10 years ago
- Google Books Downloader / Image Scraper☆53Updated 5 years ago
- A youtube-dl extension with pluggable extractors☆49Updated last month
- WarcMiddleware lets users seamlessly download a mirror copy of a website when running a web crawl with the Python web crawler Scrapy.☆46Updated 7 years ago
- Save a bunch of web pages as a self-contained, compressed archive file for offline storage and sharing.☆35Updated 12 years ago
- ☆32Updated 9 years ago
- a Python program/library to download an entire reddit thread's comment section☆18Updated 2 years ago
- Increment a URL or go to the next page. Supports auto, multi, and advanced incrementing functions.☆43Updated last month