Alternatives and similar repositories for cc-index-server

Users that are interested in cc-index-server are comparing it to the libraries listed below

• xiaoganghan / wikientities
  Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts
  ☆59Updated 13 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• dbpedia / topicmodel-extractor
  A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea
  ☆13Updated 9 years ago
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 5 years ago
• cocrawler / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆184Updated last week
• Lab41 / pythia
  Supervised learning for novelty detection in text
  ☆78Updated 8 years ago
• mitll / topic-clustering
  ☆44Updated 9 years ago
• DiceTechJobs / VectorsInSearch
  Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…
  ☆86Updated 4 years ago
• bkj / wit
  Algorithms for "schema matching"
  ☆26Updated 9 years ago
• LanguageMachines / LuigiNLP
  A workflow system for Natural Language Processing.
  ☆21Updated 5 years ago
• zelandiya / maui-standalone
  ☆21Updated 7 years ago
• SeldonIO / semantic-vectors-lucene-tools
  Tools for building a Lucene index for Semantic Vectors
  ☆21Updated 10 years ago
• treygrainger / semantic-knowledge-graph
  ☆19Updated 7 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆201Updated 7 years ago
• commoncrawl / cc-mrjob
  Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
  ☆166Updated 3 years ago
• iptc / extra
  Homebase of the IPTC EXTRA project about rule-based text categorization
  ☆13Updated 8 years ago
• alexyorke / butter-fingers
  A python library to generate highly realistic typos (fuzz-testing)
  ☆12Updated 6 months ago
• fnielsen / wembedder
  Wikidata embedding
  ☆51Updated 11 months ago
• eXascaleInfolab / TRank
  Ranking Entity Types using the Web of Data
  ☆30Updated 8 years ago
• leondz / entity_recognition
  framework for doing NER and other types of entity recognition, in Python
  ☆68Updated 3 years ago
• diffbot / wikistatsextractor
  Extract statistics from Wikipedia Dump files.
  ☆26Updated 4 years ago
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆122Updated 2 months ago
• vespa-cloud / cord-19-search
  Vespa application making an index of the CORD-19 dataset.
  ☆39Updated 3 months ago
• inventaire / entities-search-engine
  Scripts and microservice to feed an ElasticSearch with Wikidata and Inventaire entities, and keep those up-to-date
  ☆41Updated 4 years ago
• uhh-lt / targer
  A web application tagging and retrieval of arguments in text
  ☆29Updated 2 years ago
• cltl / SpaCy-to-NAF
  spaCy-to-naf converter
  ☆21Updated 4 months ago
• commoncrawl / cc-crawl-statistics
  Statistics of Common Crawl monthly archives mined from URL index files
  ☆193Updated last week
• maxdotio / neural-solr
  Neural Solr = Solr 9 + Mighty Inference + Node
  ☆18Updated 3 years ago
• allenai / grobid
  A machine learning software for extracting information from scholarly documents
  ☆23Updated 4 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 7 years ago