USCDataScience / sparklerLinks
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
☆418Updated 2 years ago
Alternatives and similar repositories for sparkler
Users that are interested in sparkler are comparing it to the libraries listed below
Sorting:
- A scalable, mature and versatile web crawler based on Apache Storm☆933Updated last week
- Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.☆445Updated last month
- An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP☆274Updated 2 years ago
- Mazerunner extends a Neo4j graph database to run scheduled big data graph compute algorithms at scale with HDFS and Apache Spark.☆383Updated 2 years ago
- A text tagger based on Lucene / Solr, using FST technology☆177Updated last year
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆220Updated 2 years ago
- Query preprocessor for Java-based search engines (Querqy Core and Lucene implementation)☆187Updated last week
- Spark RDD with Lucene's query and entity linkage capabilities☆128Updated 3 weeks ago
- This project combines Apache Spark and Elasticsearch to enable mining & prediction for Elasticsearch.☆211Updated 10 years ago
- Kite SDK☆394Updated 2 years ago
- The Apache Gora open source framework provides an in-memory data model and persistence for big data.☆122Updated last year
- Serverless proxy for Spark cluster☆325Updated 4 years ago
- Elasticsearch entity resolution plugin based on Duke☆209Updated 5 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆246Updated 2 weeks ago
- Dice Solr Plugins from Simon Hughes Dice.com☆88Updated 4 years ago
- Code to index HDFS to Solr using MapReduce☆52Updated 6 years ago
- Score documents with pure dot product / cosine similarity with ES☆254Updated 4 years ago
- ☆75Updated 5 years ago
- HBase as a TinkerPop Graph Database☆261Updated last week
- Mirror of Apache Atlas (Incubating)☆95Updated 2 years ago
- GraphAware Framework Module for Integrating Neo4j with Elasticsearch☆265Updated 4 years ago
- Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark☆142Updated last week
- spark + drools☆103Updated 3 years ago
- Building recommenders with Elastic Graph!☆37Updated 5 years ago
- Data Integration Graph☆207Updated 7 years ago
- Apache Spark applications☆70Updated 7 years ago
- Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.☆341Updated 5 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago
- Carrot2 plugin for ElasticSearch☆291Updated 2 years ago
- Apache Spark based ETL Engine☆71Updated 8 years ago