Alternatives and similar repositories for commoncrawl-crawler

Users that are interested in commoncrawl-crawler are comparing it to the libraries listed below

• DigitalPebble / behemoth
  Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.
  ☆284Updated 7 years ago
• codelibs / elasticsearch-minhash
  Elasticsearch plugin for b-bit minhash algorism
  ☆62Updated last year
• treygrainger / solr-in-action
  Sample code, data, and configuration for the book
  ☆189Updated 4 years ago
• pranab / hoidla
  Set of real time stream processing algorithms that can be used by big data streaming platform
  ☆73Updated 6 months ago
• apache / gora
  The Apache Gora open source framework provides an in-memory data model and persistence for big data.
  ☆121Updated last year
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 9 years ago
• crawler-commons / crawler-commons
  A set of reusable Java components that implement functionality common to any web crawler
  ☆252Updated this week
• JorenSix / TarsosLSH
  A Java library implementing practical nearest neighbour search algorithm for multidimensional vectors that operates in sublinear time. It…
  ☆202Updated 5 years ago
• carrot2 / elasticsearch-carrot2
  Carrot2 plugin for ElasticSearch
  ☆295Updated 3 years ago
• ClearTK / cleartk
  Machine learning components for Apache UIMA
  ☆132Updated 2 years ago
• pmerienne / trident-ml
  Trident-ML : A realtime online machine learning library
  ☆384Updated 2 years ago
• jaibeermalik / searchanalytics-bigdata
  Customer Product search clicks analytics using big data Hadoop, Hive, Oozie, ElasticSearch, Akka, Spring Data
  ☆73Updated 3 years ago
• thunderain-project / thunderain
  A Real-Time Analytical Processing (RTAP) example using Spark/Shark
  ☆51Updated 11 years ago
• calrissian / flowmix
  Flowmix is a flexible event processing engine for Apache Storm. It supports complex correlations of events via sliding/tumbling windows. …
  ☆59Updated 9 years ago
• o19s / lucene-query-example
  Educational Examle of a custom Lucene Query & Scorer
  ☆48Updated 5 years ago
• LinkedInAttic / rest.li-api-hub
  API Hub is a web UI for browsing and searching a catalog of Rest.li APIs.
  ☆74Updated 6 years ago
• jprante / elasticsearch-index-termlist
  Elasticsearch Index Termlist
  ☆118Updated 6 years ago
• javasoze / clue
  command line tool for Apache Lucene
  ☆164Updated 2 weeks ago
• RedisLabs / spark-timeseries
  A library for financial and time series calculations on Apache Spark
  ☆28Updated 10 years ago
• lumongo / lumongo
  Distributed Realtime Search with Lucene and MongoDB
  ☆60Updated 7 years ago
• gridgain / gridgain-old
  ☆266Updated 9 years ago
• lucidworks / storm-solr
  Storm / Solr Integration
  ☆19Updated 2 years ago
• tamingtext / book
  Taming Text Book Source Code
  ☆383Updated 2 years ago
• akkumar / hbasene
  HBase as the backing store for the TF-IDF representations for Lucene
  ☆109Updated 15 years ago
• YahooArchive / samoa
  SAMOA (Scalable Advanced Massive Online Analysis) is an open-source platform for mining big data streams.
  ☆428Updated 9 years ago
• basis-technology-corp / Java-readability
  A port of the arclabs 'readability' package to Java
  ☆72Updated 13 years ago
• o19s / elastic-graph-recommender
  Building recommenders with Elastic Graph!
  ☆36Updated 5 years ago
• pulsarIO / jetstream
  Jetstream is a streaming processing framework
  ☆115Updated 10 years ago
• stepthom / lucene-lda
  Using latent Dirichlet allocation (LDA) in Apache Lucene
  ☆57Updated 13 years ago
• USCDataScience / sparkler
  Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
  ☆419Updated 2 years ago