ChrisCates / CommonCrawlerLinks
🕸 A simple way to extract data from Common Crawl
☆34Updated 5 years ago
Alternatives and similar repositories for CommonCrawler
Users that are interested in CommonCrawler are comparing it to the libraries listed below
Sorting:
- Read and write WARC files in Go☆47Updated 7 years ago
- 🔍 Lens is an opt-in search engine and data collection tool to aid content discovery of the distributed web☆61Updated 6 years ago
- Removes most frequent words (stop words) from a text content. Based on a Curated list of language statistics.☆152Updated 2 years ago
- Simple Email Parser☆47Updated 9 years ago
- Stream, filter and react to Twitter status updates on the command line☆13Updated 7 years ago
- Livestreaming via IPFS☆23Updated 2 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆24Updated 12 years ago
- Go port of secret-handshake☆45Updated last year
- Serve millions of JSON documents via HTTP.☆70Updated last year
- Go implementation of haadcode's orbit-db☆11Updated 9 years ago
- Datastore implementation using badger as backend.☆58Updated 4 months ago
- Gonudb is an append-only key/value datastore written in Go.☆19Updated 2 years ago
- A Go SDK to make voice calls & send SMS using Plivo and to generate Plivo XML☆33Updated 2 months ago
- Zero knowledge push relay☆33Updated 6 years ago
- Realtime data exchange platform for Smart Cities☆26Updated 5 years ago
- simple base58 codec☆20Updated 8 years ago
- HTTP on top of libp2p☆67Updated 4 months ago
- BlackholeDB is a simple distributed key-value DB based on IPFS protocol.☆124Updated 5 months ago
- Text summarizer for golang using LexRank☆137Updated 3 months ago
- NAT port mapping library for go-libp2p☆63Updated 3 years ago
- An PDU implementation in Go☆49Updated 11 months ago
- Go language wrapper around the natty NAT-traversal utility☆35Updated 7 years ago
- TextRank implementation in Golang with extendable features (summarization, phrase extraction) and multithreading (goroutine).☆221Updated 6 months ago
- Document Indexing and Searching Library in Go☆19Updated 5 years ago
- A simple, lightweight, embedded geocoder for Golang with city level accuracy☆73Updated 10 years ago
- Object mapping for golang.☆48Updated 2 years ago
- A Go scraper aimed at scrapping quotes.☆54Updated 5 years ago
- libp2p WebRTC transport in Go that includes a discovery mechanism provided by the signalling-star☆27Updated 6 years ago
- Nifty library to manage, query and store RDF triples. Make RDF great again!☆116Updated 6 years ago
- a resource sentinel that keeps connection count under reasonable bounds☆21Updated 3 years ago