Alternatives and similar repositories for elasticrawl

Users that are interested in elasticrawl are comparing it to the libraries listed below

• twitter-archive / clockworkraven
  Human-Powered Data Analysis with Mechanical Turk
  ☆300Updated 12 years ago
• trivio / common_crawl_index
  Index URLs in Common Crawl
  ☆194Updated 7 years ago
• paulhoule / infovore
  RDF-Centric Map/Reduce Framework and Freebase data conversion tool
  ☆149Updated 3 years ago
• pandastrike / bayzee
  Text classification using Naive Bayes and Elasticsearch
  ☆154Updated 9 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• overview / overview-server
  Open source large document set visualization platform
  ☆269Updated 2 years ago
• commoncrawl / cc-mrjob
  Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
  ☆167Updated 3 years ago
• chrismattmann / imagecat
  ImageCat is an Apache OODT RADIX application that uses Apache Solr, Apache Tika and Apache OODT to ingest 10s of millions of files (image…
  ☆96Updated 6 years ago
• matpalm / resemblance
  trying shingling / resemblance / simhash / sketching to do some data deduping
  ☆99Updated 9 years ago
• PredictionIO / Demo-Tapster
  ☆23Updated 9 years ago
• WING-NUS / SWING
  The Summarizer from the Web IR / NLP Group (WING), hence SWING, is a modular, state-of-the-art automatic extractive text summarization sy…
  ☆39Updated 10 years ago
• semanticize / st
  Semanticizest: dump parser and client
  ☆20Updated 9 years ago
• rufuspollock-okfn / facetview
  FacetView is a pure javascript frontend for ElasticSearch.
  ☆291Updated 10 years ago
• NCSU-Libraries / lentil
  Lentil is no longer supported. Lentil is a Ruby on Rails Engine that supports the harvesting of images from Instagram.
  ☆58Updated 6 years ago
• danvk / localturk
  Mechanical Turk on your own machine.
  ☆207Updated 9 months ago
• thebigdb / akiva
  Akiva is a simple natural-language-processing, question-answering, artificial intelligence.
  ☆348Updated 11 years ago
• pjlsergeant / ziprip
  Extract postal addresses from the DOM
  ☆66Updated 12 years ago
• rossf7 / wikireverse
  Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.
  ☆38Updated 6 years ago
• dbpedia-spotlight / wikipedia-stats-extractor
  Raw Wikipedia counts for entity linking
  ☆19Updated 8 years ago
• klacointe / wikidata-client
  Wikidata and Wikipedia API client.
  ☆35Updated last year
• benhamner / hillary-clinton-emails
  Code to transform Hillary's emails from raw PDF documents to a SQLite database
  ☆161Updated 9 years ago
• DerwenAI / exsto
  Analyze the structure and dynamics of an open source project's developer community, using graph algorithms, etc.
  ☆58Updated 4 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆195Updated 6 years ago
• thammegowda / tika-ner-corenlp
  Stanford CoreNLP NER addon for Apache Tika's NamerEntityParser
  ☆13Updated 3 years ago
• cantino / twitter_to_csv
  Dump the Twitter stream to JSON and CSV, then apply filters, reject non-English content, do sentiment analysis, and more.
  ☆65Updated 10 years ago
• sunlightlabs / name-cleaver
  Parser and standardizer for politician, individual and organization names.
  ☆129Updated 8 years ago
• infochimps-labs / big_data_for_chimps
  A Seriously Fun guide to Big Data Analytics in Practice
  ☆169Updated 10 years ago
• lintool / warcbase
  Warcbase is an open-source platform for managing analyzing web archives
  ☆162Updated 7 years ago
• dannguyen / abbyy-finereader-ocr-senate
  Evaluating the performance and accuracy of ABBYY FineReader's OCR on Senate Financial Disclosure scanned forms
  ☆132Updated 9 years ago
• dbpedia / dbpedia-live-mirror
  Keeps a mirror of DBpedia live in sync
  ☆26Updated 3 years ago