Alternatives and similar repositories for commoncrawl-crawler:

Users that are interested in commoncrawl-crawler are comparing it to the libraries listed below

• Findwise / Hydra
  Distributed processing framework for search solutions
  ☆81Updated 2 years ago
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 8 years ago
• Heliosearch / heliosearch
  The next generation of open source search
  ☆91Updated 7 years ago
• senseidb / sensei
  distributed realtime searchable database
  ☆116Updated 10 years ago
• emorynlp / nlp4j-old
  NLP tools developed by Emory University.
  ☆60Updated 8 years ago
• Smerity / cc-warc-examples
  CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
  ☆56Updated 3 years ago
• rdelbru / SIREn
  SIREn - Semi-Structured Information Retrieval Engine
  ☆107Updated 3 years ago
• o19s / lazy-semantic-indexing
  Elasticsearch Latent Semantic Indexing experimentation
  ☆33Updated 5 years ago
• lumongo / lumongo
  Distributed Realtime Search with Lucene and MongoDB
  ☆59Updated 6 years ago
• jprante / elasticsearch-index-termlist
  Elasticsearch Index Termlist
  ☆117Updated 5 years ago
• knowitall / openregex
  An efficient and flexible token-based regular expression language and engine.
  ☆75Updated 10 years ago
• ept / warc-hadoop
  WARC (Web Archive) Input and Output Formats for Hadoop
  ☆35Updated 10 years ago
• stepthom / lucene-lda
  Using latent Dirichlet allocation (LDA) in Apache Lucene
  ☆58Updated 12 years ago
• LinkedInAttic / rest.li-api-hub
  API Hub is a web UI for browsing and searching a catalog of Rest.li APIs.
  ☆74Updated 5 years ago
• OpenSextant / SolrTextTagger
  A text tagger based on Lucene / Solr, using FST technology
  ☆176Updated last year
• o19s / lucene-query-example
  Educational Examle of a custom Lucene Query & Scorer
  ☆48Updated 5 years ago
• apache / incubator-retired-blur
  Mirror of Apache Blur
  ☆33Updated 6 years ago
• DigitalPebble / TextClassification
  A Text Classification API in Java originally developed by DigitalPebble Ltd. The API is independent from the ML implementations used and …
  ☆48Updated 3 years ago
• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆281Updated 6 years ago
• lucidworks / storm-solr
  Storm / Solr Integration
  ☆19Updated last year
• bayofmany / peapod
  A new object-graph-wrapper for the Tinkerpop 3 graph stack.
  ☆40Updated 3 years ago
• behas / lucene-skos
  SKOS Support for Apache Lucene and Solr
  ☆56Updated 3 years ago
• apache / gora
  The Apache Gora open source framework provides an in-memory data model and persistence for big data.
  ☆121Updated last year
• apache / opennlp-sandbox
  Apache OpenNLP Sandbox
  ☆43Updated this week
• basis-technology-corp / Java-readability
  A port of the arclabs 'readability' package to Java
  ☆72Updated 12 years ago
• pranab / hoidla
  Set of real time stream processing algorithms that can be used by big data streaming platform
  ☆72Updated 4 years ago
• pulsarIO / jetstream
  Jetstream is a streaming processing framework
  ☆113Updated 9 years ago
• kijiproject / kiji
  The Kiji project suite
  ☆33Updated 9 years ago
• sgroschupf / katta
  Katta - distributed Lucene
  ☆60Updated 11 years ago
• sematext / query-segmenter
  Solr Query Segmenter for structuring unstructured queries
  ☆21Updated 3 years ago