Alternatives and similar repositories for nutch-crawler

Users that are interested in nutch-crawler are comparing it to the libraries listed below

• eleflow / nutch-aws
  ☆25Updated 10 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆149Updated 3 years ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆58Updated 4 years ago
• shagunsodhani / locis
  Implementation of "A Parallel Spatial Co-location Mining Algorithm Based on MapReduce" paper
  ☆49Updated 7 years ago
• sjyk / sampleclean-async
  ☆92Updated 9 years ago
• rwalk / straw
  A platform for real-time streaming search
  ☆102Updated 9 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆52Updated 8 years ago
• Dwolla / arbalest
  Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…
  ☆41Updated 9 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• ContinuumIO / topik
  A Topic Modeling toolbox
  ☆92Updated 9 years ago
• sdhu / elasticsearch-prediction
  ElasticSearch Prediction Generator and Plugin
  ☆22Updated 9 years ago
• rossf7 / elasticrawl
  Launch AWS Elastic MapReduce jobs that process Common Crawl data.
  ☆49Updated 8 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• nasa-jpl-memex / topic_space
  Topic modeling web application
  ☆41Updated 9 years ago
• algoriffic / lsa4solr
  Document clustering based on Latent Semantic Analysis
  ☆96Updated 15 years ago
• SimpleFinance / pipewelder
  Scheduled task execution on top of AWS Data Pipeline
  ☆43Updated 10 years ago
• chrismattmann / lucene-geo-gazetteer
  Uses Apache Lucene, OpenNLP and geonames and extracts locations from text and geocodes them.
  ☆37Updated last year
• uswitch / blueshift
  Automate copying data from S3 into Amazon Redshift
  ☆117Updated 3 years ago
• giantoak / unicorn
  Visualization and summarization of a collection of documents.
  ☆20Updated 3 years ago
• spinscale / elasticsearch-opennlp-plugin
  Additional opennlp mapping type for elasticsearch in order to perform named entity recognition
  ☆136Updated 9 years ago
• NLP4L / attic-nlp4l
  (deprecated) Please use new nlp4l instead.
  ☆65Updated 8 years ago
• twitter-archive / clockworkraven
  Human-Powered Data Analysis with Mechanical Turk
  ☆300Updated 12 years ago
• Houzz / hubot-luigi
  Luigi Plugin for Hubot
  ☆36Updated 8 years ago
• PureSolTechnologies / DuctileDB
  Ductile DB is a graph database based on Hadoop/HBase which provides a vast set of features.
  ☆15Updated 7 years ago
• ogrisel / pignlproc
  Apache Pig utilities to build training corpora for machine learning / NLP out of public Wikipedia and DBpedia dumps.
  ☆158Updated 2 years ago
• jwills / exhibit
  A prototype of Hive UDFs/UDTFs that execute nested SQL queries within rows.
  ☆54Updated 9 years ago
• scrapinghub / kafka-scanner
  High Level Kafka Scanner
  ☆19Updated 7 years ago
• bscottm / elastic-lda
  Prototype plugin to support topic modeling using LDA in Elasticsearch
  ☆20Updated 9 years ago
• elsevierlabs-os / soda
  Solr Dictionary Annotator (Microservice for Spark)
  ☆71Updated 5 years ago
• aria42 / mochi
  My personal clojure library geared towards NLP applications
  ☆40Updated 14 years ago