bejean / crawl-anywhereLinks
Crawl-Anywhere - Web Crawler and document processing pipeline with Solr integration.
☆97Updated 8 years ago
Alternatives and similar repositories for crawl-anywhere
Users that are interested in crawl-anywhere are comparing it to the libraries listed below
Sorting:
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago
- ☆66Updated 8 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆216Updated 2 years ago
- Html Content / Article Extractor in Scala - open sourced from Gravity Labs - http://gravity.com☆343Updated 5 years ago
- Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…☆191Updated this week
- Solrstrap is a Query-Result interface for Solr written in JavaScript, HTML and CSS☆87Updated 8 years ago
- Automatic, zero-config web scraping -- written in Java, has no dependency on Java EE or app servers, and the web scraper has a restful/JS…☆155Updated 8 years ago
- A python library detect and extract listing data from HTML page.☆108Updated 8 years ago
- a pure javascript frontend for ElasticSearch search indices.☆80Updated 7 years ago
- Web Crawler for Elasticsearch☆234Updated 5 years ago
- Distributed Ruby Web Crawler, backed up by Redis☆123Updated 11 years ago
- Structured Data Extractor. An application to extract structured data from web pages. It uses Data Extraction Based on Partial Tree Alignm…☆49Updated 13 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆27Updated 6 years ago
- Blog crawler for the blogforever project.☆22Updated 11 years ago
- Carrot2 plugin for ElasticSearch☆290Updated 2 years ago
- Twitter River Plugin for elasticsearch (STOPPED)☆204Updated 11 months ago
- A modular dashboard that visualizes data gathered by Social Harvest server (as well as from other sources).☆36Updated 8 years ago
- Open-source Enterprise Grade Search Engine Software☆508Updated 2 years ago
- An open source search engine for corporate data and websites.☆106Updated 8 years ago
- Algorithmic summarizer for RSS/Atom Feeds, Web Urls and arbitrary text. Codebase for the application deployed at http://tldrzr.herokuapp.…☆53Updated 8 years ago
- Collects multimedia content shared through social networks.☆19Updated 10 years ago
- ☆28Updated 9 years ago
- This is a Fact based Question Answering System using Apache Solr as backend search engine, Wikipedia dumps as information source, Apache …☆26Updated 2 weeks ago
- Feed discovery to share :)☆41Updated 8 years ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆90Updated 3 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆282Updated 7 years ago
- Text classification using Naive Bayes and Elasticsearch☆154Updated 8 years ago
- A plugin for language detection in Elasticsearch using Nakatani Shuyo's language detector☆252Updated 7 years ago
- TextTeaser is an automatic summarization algorithm.☆1,977Updated 7 years ago
- open source big data integration, analytics, and visualization☆418Updated 8 years ago