Alternatives and similar repositories for cc-index-server

Users that are interested in cc-index-server are comparing it to the libraries listed below

• xiaoganghan / wikientities
  Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts
  ☆59Updated 13 years ago
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 5 years ago
• treygrainger / semantic-knowledge-graph
  ☆19Updated 7 years ago
• eXascaleInfolab / TRank
  Ranking Entity Types using the Web of Data
  ☆30Updated 9 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 7 years ago
• zelandiya / maui-standalone
  ☆21Updated 7 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 8 years ago
• Lab41 / pythia
  Supervised learning for novelty detection in text
  ☆78Updated 9 years ago
• DiceTechJobs / VectorsInSearch
  Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…
  ☆86Updated 4 years ago
• dbpedia / topicmodel-extractor
  A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea
  ☆13Updated 9 years ago
• LanguageMachines / LuigiNLP
  A workflow system for Natural Language Processing.
  ☆21Updated 6 years ago
• cocrawler / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆189Updated 3 weeks ago
• mitll / topic-clustering
  ☆44Updated 9 years ago
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆124Updated last week
• google / categorybuilder
  ☆99Updated 5 years ago
• bkj / wit
  Algorithms for "schema matching"
  ☆26Updated 9 years ago
• SeldonIO / semantic-vectors-lucene-tools
  Tools for building a Lucene index for Semantic Vectors
  ☆21Updated 10 years ago
• alexyorke / butter-fingers
  A python library to generate highly realistic typos (fuzz-testing)
  ☆13Updated 8 months ago
• andychisholm / sift
  Knowledge extraction from web data
  ☆92Updated 7 years ago
• HazyResearch / fonduer-tutorials
  A collection of simple tutorials for using Fonduer
  ☆100Updated 5 years ago
• cltl / SpaCy-to-NAF
  spaCy-to-naf converter
  ☆21Updated 6 months ago
• semanticize / semanticizer
  Entity Linking for the masses
  ☆56Updated 10 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆205Updated 7 years ago
• uhh-lt / targer
  A web application tagging and retrieval of arguments in text
  ☆29Updated 2 years ago
• commoncrawl / cc-mrjob
  Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
  ☆168Updated 3 years ago
• idio / json-wikipedia
  Json Wikipedia, contains code to convert the Wikipedia xml dump into a json dump. Questions? https://gitter.im/idio-opensource/Lobby
  ☆17Updated 3 years ago
• pmbaumgartner / spacy-setfit-textcat
  ☆30Updated 3 years ago
• USCDataScience / autoextractor
  A toolkit for clustering web pages based on various similarity measures.
  ☆34Updated 4 years ago
• usc-isi-i2 / etk
  Extraction Toolkit
  ☆83Updated 4 years ago
• inventaire / entities-search-engine
  Scripts and microservice to feed an ElasticSearch with Wikidata and Inventaire entities, and keep those up-to-date
  ☆41Updated 4 years ago