USCDataScience / sparklerLinks
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
☆419Updated 2 years ago
Alternatives and similar repositories for sparkler
Users that are interested in sparkler are comparing it to the libraries listed below
Sorting:
- A scalable, mature and versatile web crawler based on Apache Storm☆950Updated last week
- Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.☆446Updated 3 months ago
- Spark RDD with Lucene's query and entity linkage capabilities☆128Updated 3 months ago
- A text tagger based on Lucene / Solr, using FST technology☆177Updated last year
- Query preprocessor for Java-based search engines (Querqy Core and Lucene implementation)☆189Updated this week
- An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP☆275Updated 3 years ago
- HBase as a TinkerPop Graph Database☆261Updated 3 weeks ago
- Score documents with pure dot product / cosine similarity with ES☆254Updated 4 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆222Updated 2 years ago
- The Apache Gora open source framework provides an in-memory data model and persistence for big data.☆121Updated last year
- Code to index HDFS to Solr using MapReduce☆52Updated 7 years ago
- Carrot2 plugin for ElasticSearch☆293Updated 2 years ago
- This project combines Apache Spark and Elasticsearch to enable mining & prediction for Elasticsearch.☆211Updated 11 years ago
- Data Integration Graph☆207Updated 7 years ago
- Solr query parser plugin that performs proper query-time synonym expansion.☆149Updated 4 years ago
- Apache OpenNLP Sandbox☆45Updated this week
- Elasticsearch entity resolution plugin based on Duke☆209Updated 5 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- Dice Solr Plugins from Simon Hughes Dice.com☆88Updated 4 years ago
- Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark☆142Updated last week
- Serverless proxy for Spark cluster☆324Updated 5 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆161Updated 3 years ago
- Banana for Solr - A Port of Kibana☆672Updated 4 months ago
- Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…☆197Updated this week
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago
- Search Quality Evaluation Tool for Apache Solr & Elasticsearch search-based infrastructures☆192Updated 2 weeks ago
- Elastic Search on Spark☆112Updated 11 years ago
- A high performance "thin wrapper" HTTP REST server on top of Apache Lucene☆146Updated last year
- Structured Streaming Machine Learning example with Spark 2.0☆94Updated 8 years ago
- Mazerunner extends a Neo4j graph database to run scheduled big data graph compute algorithms at scale with HDFS and Apache Spark.☆383Updated 2 years ago