momer / nutch-selenium-grid-plugin
A Nutch 2.2.1 plugin which allows users to shuffle off the responsibility for retrieving pages to a selenium hub/node spoke system. This allows Nutch to rely on Selenium/Firefox to fetch and load javascript/content; while keeping Nutch in charge of what it does best: crawling and further parsing.
☆16Updated 8 years ago
Related projects ⓘ
Alternatives and complementary repositories for nutch-selenium-grid-plugin
- ☆28Updated 8 years ago
- Nutch with Cassandra and Elasticsearch on Docker☆16Updated 3 years ago
- Simplified scalable aggregation and processing framework built upon Apache Camel.☆22Updated 6 years ago
- ☆19Updated 2 years ago
- Allows a Storm topology to consume an AMQP exchange as an input source.☆59Updated 11 years ago
- The first Open Source document analysis platform☆65Updated 3 years ago
- The next generation of open source search☆91Updated 7 years ago
- ☆50Updated 9 years ago
- A big data cluster management tool that creates and manages clusters of different technologies.☆21Updated 9 years ago
- An Elasticsearch river modelled to work like the Solr MySQL import feature☆55Updated 10 years ago
- Apache Camel, Kafka Component☆21Updated 10 years ago
- Katta - distributed Lucene☆60Updated 11 years ago
- Another kafka-hadoop-consumer☆25Updated 11 years ago
- Storm / Solr Integration☆19Updated 9 months ago
- ☆18Updated 7 years ago
- Interactive shell for Hadoop☆21Updated 2 years ago
- Ready-to-use, manually tuned Cloudera Hadoop Distribution 5 provisioned cluster☆68Updated 8 years ago
- Restful pipeline command support plugin for Elasticsearch☆33Updated 8 years ago
- Code to index HDFS to Solr using MapReduce☆51Updated 5 years ago
- Skywalker for Elasticsearch is like Luke for Lucene☆79Updated 4 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆212Updated last year
- Pinot 是一个实时分布式的 OLAP 数据存储和分析系统。LinkedIn 使用它实现低延迟可伸缩的实时分析。Pinot 从离线数据源（包括 Hadoop 和各类文件）和在线数据源（如 Kafka）中攫取数据进行分析。Pinot 被设计是可以进行水平扩展的☆15Updated 9 years ago
- CSV river for ElasticSearch☆91Updated 7 years ago
- A JHipster app reporting to Spark Streaming☆14Updated 9 years ago
- off the shelf infrastructure☆25Updated 11 months ago
- Lucene indexes for OrientDB☆35Updated 2 years ago