zytedata / web-snapLinks
Create "perfect" snapshots of web pages
☆33Updated last week
Alternatives and similar repositories for web-snap
Users that are interested in web-snap are comparing it to the libraries listed below
Sorting:
- A helper library full of URL-related heuristics.☆73Updated 4 months ago
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated last year
- 🧩 Proposal to allow user scripts like "expand comments", "hide popups", "fill out this form", etc. to be reusable across pure browser en…☆19Updated 6 months ago
- Tool to index and serve HTML files. Powered by Datasette.☆111Updated 3 years ago
- Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…☆113Updated 2 years ago
- Lightweight JavaScript library to interact with Chromium-based browsers via the Chrome DevTools Protocol☆27Updated last year
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆58Updated last year
- A curated list of well-known URIs, resources, guides and tools (RFC 5785)☆86Updated last year
- Coldbrew is Python compiled into JavaScript using Emscripten.☆31Updated 3 years ago
- Spider templates for automatic crawlers.☆34Updated 3 weeks ago
- A self-hosted bookmark database with full-text page content search☆96Updated 8 months ago
- Awesome links related to RSS, ATOM, and Syndication formats.☆61Updated last year
- Scrape HN to track links from specific domains☆74Updated this week
- A single tab web browser built with puppeteer. Also, no client-side JS. Viewport is streamed with MJPEG. For realz.☆59Updated 2 years ago
- Export your Github activity: events, repositories, stars, etc.☆56Updated 6 months ago
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆12Updated last year
- A modified version of searx (the privacy-respecting metasearch engine) to only search an allowlist of sites, to build functionality simil…☆19Updated 4 years ago
- Zyte API integration for Scrapy☆39Updated last week
- Upload SQLite database files to Datasette☆14Updated 2 months ago
- A framework for quick web archiving; canonical repository: https://gitea.arpa.li/JustAnotherArchivist/qwarc☆30Updated 2 weeks ago
- Decentralized web archiving☆20Updated 7 years ago
- List of free and checked http, https, socks4 and socks5 proxies☆17Updated 2 weeks ago
- Create a static website with Fly - HTML from the example☆21Updated last year
- Downloads websites for long-term archival.☆84Updated this week
- A code editing & sharing utility☆12Updated 2 years ago
- The Toolkit API, app, and browser extension. Start preserving now.☆47Updated last week
- Create a SQLite database containing data from your Pocket account☆107Updated 2 years ago
- Web scraping Page Objects core library☆104Updated this week
- DomainsProject.org HTTP worker☆25Updated 3 years ago
- A case management app built with Lowdefy.☆32Updated 2 years ago