Alternatives and similar repositories for nutch-crawler:

Users that are interested in nutch-crawler are comparing it to the libraries listed below

• rossf7 / elasticrawl
  Launch AWS Elastic MapReduce jobs that process Common Crawl data.
  ☆49Updated 8 years ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆58Updated 4 years ago
• gnip / sample-kinesis-connector
  A sample application that consumes from twitter using HBC and producing into Amazon Kinesis
  ☆12Updated 9 years ago
• jpatanooga / Lumberyard
  iSAX Indexing persisted in HBase
  ☆39Updated 13 years ago
• stitchfix / s3drive
  S3 backed ContentsManager for jupyter notebooks
  ☆13Updated 9 years ago
• PureSolTechnologies / DuctileDB
  Ductile DB is a graph database based on Hadoop/HBase which provides a vast set of features.
  ☆13Updated 7 years ago
• tjake / stormscraper
  A Storm based web crawler with Cassandra backend
  ☆28Updated 11 years ago
• jwills / exhibit
  A prototype of Hive UDFs/UDTFs that execute nested SQL queries within rows.
  ☆54Updated 9 years ago
• shagunsodhani / locis
  Implementation of "A Parallel Spatial Co-location Mining Algorithm Based on MapReduce" paper
  ☆49Updated 7 years ago
• josephreisinger / dist_lda
  distributed latent dirichlet allocation
  ☆30Updated 13 years ago
• algoriffic / lsa4solr
  Document clustering based on Latent Semantic Analysis
  ☆96Updated 14 years ago
• avibryant / simmer
  Reduce your data. A unix filter for algebird-powered aggregation.
  ☆138Updated 7 years ago
• tdunning / pig-vector
  Mahout vector encoding for pig
  ☆54Updated 2 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆148Updated 3 years ago
• jupyter-incubator / proposals
  Proposals for new Jupyter subprojects to enter into incubation
  ☆18Updated 4 years ago
• chrismattmann / lucene-geo-gazetteer
  Uses Apache Lucene, OpenNLP and geonames and extracts locations from text and geocodes them.
  ☆37Updated 11 months ago
• hammerlab / dask-distributed-on-kubernetes
  Deploy dask-distributed on google container engine using kubernetes
  ☆40Updated 5 years ago
• nasa-jpl-memex / topic_space
  Topic modeling web application
  ☆40Updated 9 years ago
• amplab / ampcrowd
  A RESTful web service that runs microtasks across multiple crowds, provides quality control techniques, and is easily extensible.
  ☆51Updated 7 years ago
• babbel / floto
  Task Orchestration Tool Based on SWF and boto3
  ☆38Updated 6 years ago
• ericchiang / cloudy-tweets
  Machine Learning solution for Kaggle.com's "Partly Sunny with a Chance of Hashtags"
  ☆27Updated 11 years ago
• Dwolla / arbalest
  Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…
  ☆41Updated 9 years ago
• momer / nutch-selenium
  ☆28Updated 8 years ago
• BIDData / BIDMach_Spark
  Code to allow running BIDMach on Spark including HDFS integration and lightweight sparse model updates (Kylix).
  ☆15Updated 4 years ago
• laserson / dsq
  Distributed Streaming Quantiles (for PySpark)
  ☆38Updated 11 years ago
• giantoak / unicorn
  Visualization and summarization of a collection of documents.
  ☆20Updated 2 years ago
• eleflow / nutch-aws
  ☆25Updated 9 years ago
• yu-iskw / spark-dataframe-introduction
  This is an introduction of Apache Spark DataFrames.
  ☆41Updated 10 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• twitter-archive / clockworkraven
  Human-Powered Data Analysis with Mechanical Turk
  ☆300Updated 12 years ago