Alternatives and similar repositories for CommonCrawler

Users that are interested in CommonCrawler are comparing it to the libraries listed below

• RTradeLtd / Lens
  🔍 Lens is an opt-in search engine and data collection tool to aid content discovery of the distributed web
  ☆61Updated 6 years ago
• slyrz / warc
  Read and write WARC files in Go
  ☆46Updated 7 years ago
• DavidBelicza / TextRank
  TextRank implementation in Golang with extendable features (summarization, phrase extraction) and multithreading (goroutine).
  ☆218Updated 3 months ago
• lastzero / tweethog
  Stream, filter and react to Twitter status updates on the command line
  ☆13Updated 7 years ago
• bbalet / stopwords
  Removes most frequent words (stop words) from a text content. Based on a Curated list of language statistics.
  ☆149Updated 2 years ago
• ipfs / go-ds-badger
  Datastore implementation using badger as backend.
  ☆58Updated last month
• multiformats / go-multihash
  Multihash implementation in Go
  ☆241Updated last month
• didasy / tldr
  Text summarizer for golang using LexRank
  ☆133Updated last year
• chewxy / lingo
  package lingo provides the data structures and algorithms required for natural language processing
  ☆156Updated 2 years ago
• bitmaelum / bitmaelum-suite
  BitMaelum software suite
  ☆62Updated 2 years ago
• wallix / triplestore
  Nifty library to manage, query and store RDF triples. Make RDF great again!
  ☆115Updated 6 years ago
• sanbornm / mp
  Simple Email Parser
  ☆47Updated 9 years ago
• mtojek / go-libp2p-webrtc-star
  libp2p WebRTC transport in Go that includes a discovery mechanism provided by the signalling-star
  ☆27Updated 6 years ago
• kbullaughey / warc-tools
  Miscellaneous tools for processing WARC files from the CommonCrawl
  ☆24Updated 11 years ago
• jbenet / goprocess
  goprocess - like Context, but with good close semantics.
  ☆73Updated 5 years ago
• afjoseph / RAKE.Go
  A Go port of the Rapid Automatic Keyword Extraction algorithm (RAKE)
  ☆121Updated 3 months ago
• alash3al / bbadger
  adding badger support to blevesearch
  ☆63Updated 2 years ago
• urandom / text-summary
  Summarizes text
  ☆39Updated 10 years ago
• iand / gonudb
  Gonudb is an append-only key/value datastore written in Go.
  ☆19Updated last year
• ipfs / go-unixfs
  Implementation of a unix-like filesystem on top of an ipld merkledag
  ☆105Updated 2 years ago
• google / note-maps
  A personal knowledge base, an experimental project under development.
  ☆128Updated 4 months ago
• spy16 / fabric
  Fabric is a simple triplestore written in Golang
  ☆198Updated 2 years ago
• bregydoc / blackholeDB
  BlackholeDB is a simple distributed key-value DB based on IPFS protocol.
  ☆124Updated last month
• berty / zero-push
  Zero knowledge push relay
  ☆33Updated 6 years ago
• keks / go-orbitdb
  Go implementation of haadcode's orbit-db
  ☆11Updated 8 years ago
• Nhoya / SplitShare
  Shamir's Secret Sharing Algorithm implementation in golang combined with PGP and a mail delivery system
  ☆35Updated 7 years ago
• libp2p / go-libp2p-nat
  NAT port mapping library for go-libp2p
  ☆62Updated 3 years ago
• libp2p / go-libp2p-http
  HTTP on top of libp2p
  ☆65Updated last month
• ImVexed / fasturl
  A fast URL parser for Go
  ☆40Updated 2 years ago
• greenpeace / gpes-check-my-pages
  Scrapping script used to test the Spanish web archive and redirects system, with more than 10,000 pages. It checks redirections, http res…
  ☆46Updated 4 years ago