ChrisCates / CommonCrawlerLinks
🕸 A simple way to extract data from Common Crawl
☆34Updated 5 years ago
Alternatives and similar repositories for CommonCrawler
Users that are interested in CommonCrawler are comparing it to the libraries listed below
Sorting:
- 🔍 Lens is an opt-in search engine and data collection tool to aid content discovery of the distributed web☆61Updated 5 years ago
- simple base58 codec☆20Updated 8 years ago
- Go port of secret-handshake☆45Updated 7 months ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆24Updated 11 years ago
- NAT port mapping library for go-libp2p☆62Updated 3 years ago
- Advanced declarative web scraping☆30Updated 2 years ago
- Simple Email Parser☆47Updated 9 years ago
- A Go implementation of the OTR 3 protocol, with libotr 4.1.0 feature parity☆74Updated 2 years ago
- textextract is a tiny library (87 lines of Go) that identifies where the article content is in a HTML page (as opposed to navigation, hea…☆11Updated 6 years ago
- Weighted PageRank implementation in Go☆86Updated 4 years ago
- A RiveScript interpreter for Go. RiveScript is a scripting language for chatterbots.☆61Updated last year
- Streaming decoder for JSON arrays☆37Updated 10 years ago
- Datastore implementation using badger as backend.☆57Updated 3 months ago
- A client and server side solution for zero knowledge authentication, in Go☆15Updated 8 years ago
- Zero knowledge push relay☆33Updated 5 years ago
- Summarizes text☆39Updated 9 years ago
- Go package for abstracting local, in-memory, and remote (Google Cloud Storage/S3) filesystems☆52Updated 6 years ago
- Go client for newsapi (https://newsapi.org/)☆37Updated 5 years ago
- Text summarizer for golang using LexRank☆132Updated last year
- Fast, decentralized and git-trackable database.☆49Updated 5 years ago
- Livestreaming via IPFS☆23Updated 2 years ago
- Shamir's Secret Sharing Algorithm implementation in golang combined with PGP and a mail delivery system☆35Updated 7 years ago
- Removes most frequent words (stop words) from a text content. Based on a Curated list of language statistics.☆148Updated last year
- A real-time collaborative Markdown editor and document repository with simple organization and project-based management☆52Updated 2 years ago
- An implementation of Noise in Go☆42Updated 7 years ago
- Go language wrapper around the natty NAT-traversal utility☆35Updated 6 years ago
- Compare various different Hashing Algorithms☆22Updated 7 years ago
- orc - Onion router control protocol library.☆39Updated 7 years ago
- A peer to peer service registry and discovery tool.☆39Updated 11 years ago
- SuperHacker is the ultimate utility to make you look like a hacker.☆48Updated 3 years ago