zytedata / web-snapLinks
Create "perfect" snapshots of web pages
☆33Updated this week
Alternatives and similar repositories for web-snap
Users that are interested in web-snap are comparing it to the libraries listed below
Sorting:
- Automated behaviors that run in browser to interact with complex sites automatically. Used by ArchiveWeb.page and Browsertrix Crawler.☆55Updated last week
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated 2 years ago
- A framework for quick web archiving; canonical repository: https://gitea.arpa.li/JustAnotherArchivist/qwarc☆30Updated 3 weeks ago
- A helper library full of URL-related heuristics.☆73Updated 4 months ago
- Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…☆113Updated 2 years ago
- Tool to index and serve HTML files. Powered by Datasette.☆111Updated 3 years ago
- 🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser en…☆19Updated 6 months ago
- A single tab web browser built with puppeteer. Also, no client-side JS. Viewport is streamed with MJPEG. For realz.☆59Updated 2 years ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Updated last year
- Awesome links related to RSS, ATOM, and Syndication formats.☆61Updated last year
- A modified version of searx (the privacy-respecting metasearch engine) to only search an allowlist of sites, to build functionality simil…☆19Updated 4 years ago
- Create a static website with Fly - HTML from the example☆21Updated last year
- The Toolkit API, app, and browser extension. Start preserving now.☆47Updated this week
- 🛡️📧 Protect e-mails against spam and scraping bots☆36Updated last year
- A self-hosted bookmark database with full-text page content search☆96Updated 8 months ago
- Homebrew formula for the ArchiveBox self-hosted internet archiving solution.☆28Updated last year
- The little things give you away... A collection of various small helper stuff – Mirror repo only, no longer kept in sync, refer to gitea.…☆24Updated 5 years ago
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆58Updated last year
- Run a Personal VPN with global exit nodes and proxy via Tailscale IPN☆46Updated 10 months ago
- Lightweight JavaScript library to interact with Chromium-based browsers via the Chrome DevTools Protocol☆27Updated last year
- Data cleaning and validation functions for names, languages, identifiers, etc.☆52Updated this week
- Convert HTTP Archive (HAR) -> Web Archive (WARC) format☆55Updated 7 years ago
- Pegao is a community about lists of links on topics of interest.☆13Updated 3 years ago
- Chrome extension that uses Memento to indicate that a page a user is viewing on the live web has an archived copy and to give the user ac…☆58Updated 5 months ago
- Convert an online sitemap to Atom, RSS and JSON feeds☆61Updated 2 years ago
- Search a JSON path and get the value fast☆23Updated 11 months ago
- A code editing & sharing utility☆12Updated 2 years ago
- A dockerized, queued high fidelity web archiver based on Squidwarc☆61Updated last year
- Decentralized web archiving☆20Updated 7 years ago
- An api to check social media username availability on a variety of services☆32Updated 3 years ago