openzim / python-scraperlibLinks
Collection of Python code to re-use across Python-based scrapers
☆24Updated 3 weeks ago
Alternatives and similar repositories for python-scraperlib
Users that are interested in python-scraperlib are comparing it to the libraries listed below
Sorting:
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆15Updated 5 years ago
- 🎭 An introduction to the Internet Archiving ecosystem, tooling, and some of the ethical dilemmas that the community faces.☆59Updated last year
- Clean a series of links, resolving redirects and finding Wayback results if page is gone. Originally written to aid with importing from A…☆18Updated last year
- Convert an online sitemap to Atom, RSS and JSON feeds☆61Updated 2 years ago
- DigestBox takes any webpage URL (news article, video link, comment thread, etc.) and gives you just the raw content. It's powered by Arch…☆19Updated last year
- Awesome links related to RSS, ATOM, and Syndication formats.☆60Updated last year
- Create a ZIM file from a Youtube channel/username/playlist☆79Updated last week
- ActivityPub server without Javascript, designed for simplicity and accessibility. Includes calendar, news and sharing economy features to…☆71Updated this week
- Command line RSS feed reader and json/html/pdf/epub converter☆25Updated 3 years ago
- Community spaces, consent, privacy, transparency, online.☆27Updated last month
- Command line tool to convert a file in the WARC format to a file in the ZIM format☆71Updated 7 months ago
- Javascript/Node wrapper around Mozilla's Readability library so that ArchiveBox can call it as a oneshot CLI command to extract each page…☆40Updated last year
- Gemini IPFS Gateway☆22Updated 6 months ago
- Turns a collection of documents into a browsable ZIM file☆26Updated 2 weeks ago
- Passively capture, archive, and hoard your web browsing history, including the contents of the pages you visit, for later offline viewing…☆97Updated last week
- anagora.org/node/agora-bot☆22Updated last month
- Chrome extension to add relative bookmarks to your browser☆27Updated 3 years ago
- Farm operated by bots to grow and harvest new zim files☆118Updated this week
- searchmysite.net is an open source search engine and search as a service☆134Updated 3 weeks ago
- This is the HeadQuarters of my digital info. HPI library got me inspired and I'm trying to play with the idea on a smaller scale for myse…☆21Updated last year
- Official Python package for ArchiveBox, the self-hosted internet archiving solution.☆13Updated last year
- Write and read comments on every page with a simple plug-in for your browser☆49Updated 3 years ago
- Self-hostable link database☆125Updated this week
- This is the web portal for Snikket Chat services. To learn more about what Snikket Chat services are, check the website.☆42Updated 2 weeks ago
- Offline voice-controlled music player for Raspberry Pi☆10Updated last year
- ☆89Updated 6 months ago
- Mastodon bot flying from user to user☆12Updated 7 years ago
- ☆26Updated last year
- Kiwix & openZIM build engine☆107Updated last week
- A social media RSS: peer-to-peer, offline ActivityPub client for reading and following microblogs on the Fediverse.☆16Updated 10 months ago