Alternatives and similar repositories for cc-index-server

Users that are interested in cc-index-server are comparing it to the libraries listed below

• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• xiaoganghan / wikientities
  Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts
  ☆59Updated 12 years ago
• dbpedia / topicmodel-extractor
  A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea
  ☆13Updated 8 years ago
• diffbot / wikistatsextractor
  Extract statistics from Wikipedia Dump files.
  ☆26Updated 3 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• treygrainger / semantic-knowledge-graph
  ☆19Updated 7 years ago
• helgeho / Web2Warc
  An easy-to-use and highly customizable crawler that enables you to create your own little Web archives (WARC/CDX)
  ☆25Updated 7 years ago
• iproduct-database / vpm-filter-spark
  Virtual patent marking crawler at iproduct.epfl.ch
  ☆14Updated 7 years ago
• eXascaleInfolab / TRank
  Ranking Entity Types using the Web of Data
  ☆30Updated 8 years ago
• Sotera / newman
  Quickly analyze and explore email with advanced analytics and visualization.
  ☆56Updated 3 years ago
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 4 years ago
• iptc / extra
  Homebase of the IPTC EXTRA project about rule-based text categorization
  ☆13Updated 8 years ago
• dkpro / dkpro-wsd
  DKPro WSD: A Java framework for word sense disambiguation
  ☆20Updated 2 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• idio / json-wikipedia
  Json Wikipedia, contains code to convert the Wikipedia xml dump into a json dump. Questions? https://gitter.im/idio-opensource/Lobby
  ☆17Updated 3 years ago
• mitll / topic-clustering
  ☆43Updated 9 years ago
• allenai / taggers
  Easily identify and label sentence intervals using various taggers.
  ☆16Updated 8 years ago
• trec-kba / streamcorpus-pipeline
  framework for making streamcorpus data
  ☆11Updated 8 years ago
• trivio / common_crawl_index
  Index URLs in Common Crawl
  ☆194Updated 7 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• USCDataScience / autoextractor
  A toolkit for clustering web pages based on various similarity measures.
  ☆33Updated 3 years ago
• LanguageMachines / LuigiNLP
  A workflow system for Natural Language Processing.
  ☆21Updated 5 years ago
• semanticize / semanticizer
  Entity Linking for the masses
  ☆56Updated 9 years ago
• inferlink / landmark-extractor
  ☆11Updated 6 years ago
• semanticize / st
  Semanticizest: dump parser and client
  ☆20Updated 9 years ago
• zelandiya / maui-standalone
  ☆21Updated 7 years ago
• davidjurgens / crown
  The Community-enRiched Open WordNet (CROWN)
  ☆18Updated 9 years ago
• centic9 / CommonCrawlDocumentDownload
  A small tool which uses the CommonCrawl URL Index to download documents with certain file types or mime-types. This is used for mass-test…
  ☆66Updated 2 months ago
• SkBlaz / tax2vec
  Interpretable feature construction from taxonomies for text classification
  ☆18Updated 3 years ago
• openeventdata / UniversalPetrarch
  Language-agnostic political event coding using universal dependencies
  ☆18Updated 6 years ago