bejean / crawl-anywhereLinks
Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.
☆98Updated 8 years ago
Alternatives and similar repositories for crawl-anywhere
Users that are interested in crawl-anywhere are comparing it to the libraries listed below
Sorting:
- ☆66Updated 9 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆223Updated 3 years ago
- Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…☆197Updated last week
- Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JS…☆156Updated 8 years ago
- A python library detect and extract listing data from HTML page.☆108Updated 8 years ago
- Html Content / Article Extractor in Scala - open sourced from Gravity Labs - http://gravity.com☆343Updated 6 years ago
- A plugin for language detection in Elasticsearch using Nakatani Shuyo's language detector☆251Updated 8 years ago
- Structured Data Extractor. An application to extract structured data from web pages. It uses Data Extraction Based on Partial Tree Alignm…☆49Updated 13 years ago
- Text classification using Naive Bayes and Elasticsearch☆152Updated 9 years ago
- Solrstrap is a Query-Result interface for Solr written in JavaScript, HTML and CSS☆87Updated 8 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- ☆28Updated 9 years ago
- distributed realtime searchable database☆117Updated 11 years ago
- Naive Bayes Classifier implemented with Elasticsearch Aggregations☆51Updated 11 years ago
- A tool for manage website extraction configs☆37Updated 12 years ago
- A platform for backing crowdsourcing websites, built in golang for elasticsearch☆360Updated 5 years ago
- Old and outdated version of RapidMiner Studio 5. See rapidminer-studio for the latest version 7.x☆122Updated 11 years ago
- solr-logstash☆43Updated 9 years ago
- Solr Redis Extensions☆53Updated last year
- Blog crawler for the blogforever project.☆23Updated 11 years ago
- How to spot first stories on Twitter using Storm.☆124Updated 2 years ago
- Web Crawler for Elasticsearch☆234Updated 6 years ago
- a pure javascript frontend for ElasticSearch search indices.☆80Updated 7 years ago
- Keeps a mirror of DBpedia live in sync☆27Updated 4 years ago
- Mahout Taste-based recommendation on Elasticsearch☆334Updated 6 years ago
- Carrot2 plugin for ElasticSearch☆294Updated 2 years ago
- Twitter River Plugin for elasticsearch (STOPPED)☆203Updated last year
- PredictionIO Classification Engine Template (Scala-based parallelized engine)☆39Updated 6 years ago
- New version of SQL Fiddle based on OpenIDM☆198Updated last year