Parallelized web crawler written in Golang
☆15Oct 2, 2018Updated 7 years ago
Alternatives and similar repositories for sentry
Users that are interested in sentry are comparing it to the libraries listed below
Sorting:
- Web application to allow users to add content metadata about crawled resources☆13Feb 15, 2018Updated 8 years ago
- Golang WARC (Web ARChive) Library☆30Aug 6, 2019Updated 6 years ago
- A prototype server to swarm multiple DATs for Webrecorder☆14Apr 27, 2019Updated 6 years ago
- Automating description for Web Archives in ArchivesSpace using the Archive-It CDX and Partner Data APIs☆11Aug 10, 2018Updated 7 years ago
- Web Archives for Historical Research☆13Jun 12, 2017Updated 8 years ago
- [ARCHIVED] Protocol Driven Development☆12Apr 16, 2020Updated 5 years ago
- ☆17Mar 31, 2025Updated 10 months ago
- Open-licensed IPFS-related artwork☆16May 1, 2025Updated 9 months ago
- A tool to scrape the ipfs network for information on the number of peers in the network.☆21Mar 22, 2024Updated last year
- A command line utility for listing and searching snapshots in web archives☆17Dec 21, 2023Updated 2 years ago
- Matrix mesh simulator☆22Aug 26, 2019Updated 6 years ago
- A client for the Archive-It And Webrecorder WASAPI Data Transfer API☆16Oct 18, 2019Updated 6 years ago
- Hacking challenges to learn web archive security.☆35Jun 23, 2017Updated 8 years ago
- Libp2p dissector for wireshark v2.5 (WIP)☆18Apr 2, 2018Updated 7 years ago
- A javascript for fighting link rot and content drift using link decoration and web archives.☆16Oct 31, 2024Updated last year
- 🪐 An EXPERIMENTAL p2p browser built on IPFS☆22May 9, 2023Updated 2 years ago
- A quick and ugly hack at making a blockchain on ipfs. NOT MAINTAINED☆18Feb 20, 2018Updated 8 years ago
- [DEPRECATED] Use ipfs-message-port-server/client instead:☆24Apr 15, 2021Updated 4 years ago
- A listing of world wide web archives, for humans and machines using Web Archive Manifest (WAM) yaml format☆54Dec 5, 2022Updated 3 years ago
- Local Offline Collaboration Special Interest Group☆47May 1, 2025Updated 9 months ago
- A testlab built with Nomad and Consul to analyze the behavior of p2p networks at scale☆22Jul 26, 2019Updated 6 years ago
- Simple tarball encryption☆21May 1, 2025Updated 9 months ago
- slurp down a whole HTTP directory, with parallel goodness☆19Nov 25, 2025Updated 3 months ago
- An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)☆25Oct 9, 2017Updated 8 years ago
- Nondestructive warc-in-tar to warc conversion☆27Apr 21, 2013Updated 12 years ago
- [DEPRECATED] Textile Photos... for desktop!☆20Feb 26, 2020Updated 6 years ago
- DACO - Decentralized autonomous charity organization☆10Dec 11, 2017Updated 8 years ago
- Capture screenshots, publish them to IPFS, and copy the link to the clipboard.☆49Jul 10, 2018Updated 7 years ago
- 🔎 Explore the IPLD directed acyclic graph with your keyboard☆23Nov 9, 2018Updated 7 years ago
- Interplanetary Identifiers - Implementation of the DID ( decentralized identifiers) specification over the IPFS (Interplanetary File Sys…☆61Jun 14, 2019Updated 6 years ago
- A program to generate ipfs private keys☆59Jul 10, 2025Updated 7 months ago
- CDXJ Indexing of WARC/ARCs☆33Dec 10, 2024Updated last year
- OSM vector tiles on IPFS☆29Jan 18, 2017Updated 9 years ago
- A interface you can follow to implement a valid IPLD format, resolvable through the IPLD Resolver (available in IPFS)☆29Aug 11, 2021Updated 4 years ago
- zim reader in rust☆32Dec 26, 2022Updated 3 years ago
- Continuous Delivery of static websites to IPFS☆68Aug 11, 2023Updated 2 years ago
- A Memento Aggregator CLI and Server in Go☆77Mar 4, 2025Updated 11 months ago
- Unicode database query CLI☆29Sep 30, 2021Updated 4 years ago
- [toy project 🎈] a libp2p interactive shell☆35Feb 25, 2023Updated 3 years ago